2023-09-30T01:43:56.024 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-09-30T01:43:56.024 DEBUG:teuthology.run:Teuthology command: teuthology --owner scheduled_yuriw@teuthology --name yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi --verbose --description rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/crash} --archive /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126 -- /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126/orig.config.yaml 2023-09-30T01:43:56.058 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T01:43:56.140 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126 branch: wip-yuri4-testing-2023-09-29-0928-quincy description: rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/crash} email: yweinste@redhat.com first_in_suite: false job_id: '7407126' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 2 size: 30 os_type: ubuntu os_version: '20.04' overrides: admin_socket: branch: wip-yuri4-testing-2023-09-29-0928-quincy ceph: conf: client: debug client: 20 debug mgrc: 20 debug ms: 1 global: mon election default strategy: 3 mds: debug mgrc: 20 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mgr ttl cache expire seconds: 0 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: stupid bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug mgrc: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri4-testing-2023-09-29-0928-quincy sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 owner: scheduled_yuriw@teuthology priority: 75 repo: https://github.com/ceph/ceph-ci.git roles: - - mgr.x - mon.a - mon.c - mds.a - mds.c - osd.0 - client.0 - - mgr.y - mgr.z - mon.b - mds.b - osd.1 - osd.2 - osd.3 - client.1 seed: 9810 sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 sleep_before_teardown: 0 subset: 111/120000 suite: rados suite_branch: wip-yuri4-testing-2023-09-29-0928-quincy suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 targets: smithi055.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= smithi133.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM= tasks: - install: null - ceph: log-ignorelist: - overall HEALTH_ - \(MGR_DOWN\) - \(PG_ - \(RECENT_CRASH\) - replacing it with standby - No standby daemons available wait-for-scrub: false - cephfs_test_runner: modules: - tasks.mgr.test_crash teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-09-29_19:38:56 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-09-30T01:43:56.140 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa; will attempt to use it 2023-09-30T01:43:56.141 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks 2023-09-30T01:43:56.141 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-09-30T01:43:56.143 INFO:teuthology.task.internal:Checking packages... 2023-09-30T01:43:56.165 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '93dce5e17918f8aca65993a7a2dc40233a47b481' 2023-09-30T01:43:56.165 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-09-30T01:43:56.165 INFO:teuthology.packaging:ref: None 2023-09-30T01:43:56.166 INFO:teuthology.packaging:tag: None 2023-09-30T01:43:56.166 INFO:teuthology.packaging:branch: wip-yuri4-testing-2023-09-29-0928-quincy 2023-09-30T01:43:56.166 INFO:teuthology.packaging:sha1: 93dce5e17918f8aca65993a7a2dc40233a47b481 2023-09-30T01:43:56.166 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&ref=wip-yuri4-testing-2023-09-29-0928-quincy 2023-09-30T01:43:56.308 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1165-g93dce5e1-1focal 2023-09-30T01:43:56.308 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-09-30T01:43:56.315 INFO:teuthology.task.internal:no buildpackages task found 2023-09-30T01:43:56.315 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-09-30T01:43:56.364 INFO:teuthology.task.internal:Saving configuration 2023-09-30T01:43:56.376 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-09-30T01:43:56.397 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T01:43:56.420 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 01:37:56.412657', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-09-30T01:43:56.440 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 01:37:56.414522', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIGETOy3xONfbx7kUFCNiUtRLNfkcrcEsWzPdq6Np/6Bw'} 2023-09-30T01:43:56.440 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-09-30T01:43:56.453 INFO:teuthology.task.internal:roles: ubuntu@smithi055.front.sepia.ceph.com - ['mgr.x', 'mon.a', 'mon.c', 'mds.a', 'mds.c', 'osd.0', 'client.0'] 2023-09-30T01:43:56.453 INFO:teuthology.task.internal:roles: ubuntu@smithi133.front.sepia.ceph.com - ['mgr.y', 'mgr.z', 'mon.b', 'mds.b', 'osd.1', 'osd.2', 'osd.3', 'client.1'] 2023-09-30T01:43:56.453 INFO:teuthology.run_tasks:Running task console_log... 2023-09-30T01:43:56.548 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc81e5fc040>, signals=[15]) 2023-09-30T01:43:56.548 INFO:teuthology.run_tasks:Running task internal.connect... 2023-09-30T01:43:56.555 INFO:teuthology.task.internal:Opening connections... 2023-09-30T01:43:56.555 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi055.front.sepia.ceph.com 2023-09-30T01:43:56.557 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T01:43:56.605 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi133.front.sepia.ceph.com 2023-09-30T01:43:56.606 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T01:43:56.653 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-09-30T01:43:56.660 DEBUG:teuthology.orchestra.run.smithi055:> uname -m 2023-09-30T01:43:56.683 INFO:teuthology.orchestra.run.smithi055.stdout:x86_64 2023-09-30T01:43:56.684 DEBUG:teuthology.orchestra.run.smithi055:> cat /etc/os-release 2023-09-30T01:43:56.732 INFO:teuthology.orchestra.run.smithi055.stdout:NAME="Ubuntu" 2023-09-30T01:43:56.732 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-09-30T01:43:56.732 INFO:teuthology.orchestra.run.smithi055.stdout:ID=ubuntu 2023-09-30T01:43:56.732 INFO:teuthology.orchestra.run.smithi055.stdout:ID_LIKE=debian 2023-09-30T01:43:56.732 INFO:teuthology.orchestra.run.smithi055.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-09-30T01:43:56.732 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_ID="20.04" 2023-09-30T01:43:56.733 INFO:teuthology.orchestra.run.smithi055.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-30T01:43:56.733 INFO:teuthology.orchestra.run.smithi055.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-30T01:43:56.733 INFO:teuthology.orchestra.run.smithi055.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-30T01:43:56.733 INFO:teuthology.orchestra.run.smithi055.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-30T01:43:56.733 INFO:teuthology.orchestra.run.smithi055.stdout:VERSION_CODENAME=focal 2023-09-30T01:43:56.733 INFO:teuthology.orchestra.run.smithi055.stdout:UBUNTU_CODENAME=focal 2023-09-30T01:43:56.733 INFO:teuthology.lock.ops:Updating smithi055.front.sepia.ceph.com on lock server 2023-09-30T01:43:56.752 DEBUG:teuthology.orchestra.run.smithi133:> uname -m 2023-09-30T01:43:56.760 INFO:teuthology.orchestra.run.smithi133.stdout:x86_64 2023-09-30T01:43:56.760 DEBUG:teuthology.orchestra.run.smithi133:> cat /etc/os-release 2023-09-30T01:43:56.808 INFO:teuthology.orchestra.run.smithi133.stdout:NAME="Ubuntu" 2023-09-30T01:43:56.808 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION="20.04.4 LTS (Focal Fossa)" 2023-09-30T01:43:56.808 INFO:teuthology.orchestra.run.smithi133.stdout:ID=ubuntu 2023-09-30T01:43:56.808 INFO:teuthology.orchestra.run.smithi133.stdout:ID_LIKE=debian 2023-09-30T01:43:56.808 INFO:teuthology.orchestra.run.smithi133.stdout:PRETTY_NAME="Ubuntu 20.04.4 LTS" 2023-09-30T01:43:56.808 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_ID="20.04" 2023-09-30T01:43:56.808 INFO:teuthology.orchestra.run.smithi133.stdout:HOME_URL="https://www.ubuntu.com/" 2023-09-30T01:43:56.808 INFO:teuthology.orchestra.run.smithi133.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2023-09-30T01:43:56.809 INFO:teuthology.orchestra.run.smithi133.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2023-09-30T01:43:56.809 INFO:teuthology.orchestra.run.smithi133.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2023-09-30T01:43:56.809 INFO:teuthology.orchestra.run.smithi133.stdout:VERSION_CODENAME=focal 2023-09-30T01:43:56.809 INFO:teuthology.orchestra.run.smithi133.stdout:UBUNTU_CODENAME=focal 2023-09-30T01:43:56.809 INFO:teuthology.lock.ops:Updating smithi133.front.sepia.ceph.com on lock server 2023-09-30T01:43:56.835 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-09-30T01:43:56.880 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-09-30T01:43:56.906 INFO:teuthology.task.internal:Checking for old test directory... 2023-09-30T01:43:56.906 DEBUG:teuthology.orchestra.run.smithi055:> test '!' -e /home/ubuntu/cephtest 2023-09-30T01:43:56.908 DEBUG:teuthology.orchestra.run.smithi133:> test '!' -e /home/ubuntu/cephtest 2023-09-30T01:43:56.914 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-09-30T01:43:56.957 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-09-30T01:43:56.957 DEBUG:teuthology.orchestra.run.smithi055:> test -z $(ls -A /var/lib/ceph) 2023-09-30T01:43:56.960 DEBUG:teuthology.orchestra.run.smithi133:> test -z $(ls -A /var/lib/ceph) 2023-09-30T01:43:56.977 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-09-30T01:43:57.059 INFO:teuthology.run_tasks:Running task kernel... 2023-09-30T01:43:57.074 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-09-30T01:43:57.074 INFO:teuthology.task.kernel:config {'mgr.x': {'kdb': True, 'sha1': 'distro'}, 'mgr.y': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-09-30T01:43:57.074 DEBUG:teuthology.orchestra.run.smithi055:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T01:43:57.075 DEBUG:teuthology.orchestra.run.smithi133:> test -f /run/.containerenv -o -f /.dockerenv 2023-09-30T01:43:57.080 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T01:43:57.081 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2023-09-30T01:43:57.081 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T01:43:57.082 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-09-30T01:43:57.088 INFO:teuthology.orchestra.run.smithi055.stdout:5.4.0-124-generic 2023-09-30T01:43:57.088 INFO:teuthology.task.kernel:Running kernel on smithi055: 5.4.0-124-generic 2023-09-30T01:43:57.088 DEBUG:teuthology.orchestra.run.smithi055:> sudo apt-get clean 2023-09-30T01:43:57.132 INFO:teuthology.orchestra.run.smithi133.stdout:5.4.0-124-generic 2023-09-30T01:43:57.132 INFO:teuthology.task.kernel:Running kernel on smithi133: 5.4.0-124-generic 2023-09-30T01:43:57.132 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get clean 2023-09-30T01:43:57.221 DEBUG:teuthology.orchestra.run.smithi055:> sudo apt-get update 2023-09-30T01:43:57.250 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2023-09-30T01:43:57.389 INFO:teuthology.orchestra.run.smithi055.stdout:Get:1 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-09-30T01:43:57.408 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-09-30T01:43:57.408 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://security.ubuntu.com/ubuntu focal-security InRelease [114 kB] 2023-09-30T01:43:57.409 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-09-30T01:43:57.479 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-09-30T01:43:57.491 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-09-30T01:43:57.572 INFO:teuthology.orchestra.run.smithi055.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease [114 kB] 2023-09-30T01:43:57.724 INFO:teuthology.orchestra.run.smithi055.stdout:Get:4 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,464 kB] 2023-09-30T01:43:57.792 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,852 kB] 2023-09-30T01:43:57.891 INFO:teuthology.orchestra.run.smithi055.stdout:Get:5 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [652 kB] 2023-09-30T01:43:57.902 INFO:teuthology.orchestra.run.smithi055.stdout:Get:6 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [385 kB] 2023-09-30T01:43:57.905 INFO:teuthology.orchestra.run.smithi055.stdout:Get:7 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-09-30T01:43:57.906 INFO:teuthology.orchestra.run.smithi055.stdout:Get:8 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,218 kB] 2023-09-30T01:43:57.915 INFO:teuthology.orchestra.run.smithi055.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease [108 kB] 2023-09-30T01:43:57.928 INFO:teuthology.orchestra.run.smithi055.stdout:Get:10 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-09-30T01:43:57.929 INFO:teuthology.orchestra.run.smithi055.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [309 kB] 2023-09-30T01:43:57.932 INFO:teuthology.orchestra.run.smithi055.stdout:Get:12 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-09-30T01:43:57.932 INFO:teuthology.orchestra.run.smithi055.stdout:Get:13 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [886 kB] 2023-09-30T01:43:57.943 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [885 kB] 2023-09-30T01:43:57.946 INFO:teuthology.orchestra.run.smithi055.stdout:Get:14 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [615 kB] 2023-09-30T01:43:57.956 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [469 kB] 2023-09-30T01:43:57.961 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-09-30T01:43:57.961 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.7 kB] 2023-09-30T01:43:57.961 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,330 kB] 2023-09-30T01:43:57.972 INFO:teuthology.orchestra.run.smithi055.stdout:Get:15 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [185 kB] 2023-09-30T01:43:57.972 INFO:teuthology.orchestra.run.smithi055.stdout:Get:16 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-09-30T01:43:57.972 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 http://security.ubuntu.com/ubuntu focal-security/main amd64 Packages [2,464 kB] 2023-09-30T01:43:57.976 INFO:teuthology.orchestra.run.smithi055.stdout:Get:17 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-09-30T01:43:57.976 INFO:teuthology.orchestra.run.smithi055.stdout:Get:18 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-09-30T01:43:57.977 INFO:teuthology.orchestra.run.smithi055.stdout:Get:19 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-09-30T01:43:57.977 INFO:teuthology.orchestra.run.smithi055.stdout:Get:20 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-09-30T01:43:57.979 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [325 kB] 2023-09-30T01:43:57.982 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-09-30T01:43:57.982 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,117 kB] 2023-09-30T01:43:57.992 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [748 kB] 2023-09-30T01:43:57.997 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [267 kB] 2023-09-30T01:43:57.999 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-09-30T01:43:57.999 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.9 kB] 2023-09-30T01:43:58.000 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-09-30T01:43:58.000 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-09-30T01:43:58.007 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-09-30T01:43:58.057 INFO:teuthology.orchestra.run.smithi055.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 Packages [2,852 kB] 2023-09-30T01:43:58.058 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-09-30T01:43:58.076 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-09-30T01:43:58.077 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-09-30T01:43:58.078 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-09-30T01:43:58.079 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-09-30T01:43:58.079 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-09-30T01:43:58.160 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://security.ubuntu.com/ubuntu focal-security/main i386 Packages [652 kB] 2023-09-30T01:43:58.170 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://security.ubuntu.com/ubuntu focal-security/main Translation-en [385 kB] 2023-09-30T01:43:58.175 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://security.ubuntu.com/ubuntu focal-security/main amd64 c-n-f Metadata [13.2 kB] 2023-09-30T01:43:58.175 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 Packages [2,218 kB] 2023-09-30T01:43:58.199 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://security.ubuntu.com/ubuntu focal-security/restricted i386 Packages [33.3 kB] 2023-09-30T01:43:58.199 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://security.ubuntu.com/ubuntu focal-security/restricted Translation-en [309 kB] 2023-09-30T01:43:58.203 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://security.ubuntu.com/ubuntu focal-security/restricted amd64 c-n-f Metadata [572 B] 2023-09-30T01:43:58.203 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://security.ubuntu.com/ubuntu focal-security/universe amd64 Packages [886 kB] 2023-09-30T01:43:58.213 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://security.ubuntu.com/ubuntu focal-security/universe i386 Packages [615 kB] 2023-09-30T01:43:58.221 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://security.ubuntu.com/ubuntu focal-security/universe Translation-en [185 kB] 2023-09-30T01:43:58.222 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://security.ubuntu.com/ubuntu focal-security/universe amd64 c-n-f Metadata [19.1 kB] 2023-09-30T01:43:58.226 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 http://security.ubuntu.com/ubuntu focal-security/multiverse i386 Packages [7,196 B] 2023-09-30T01:43:58.226 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 Packages [23.6 kB] 2023-09-30T01:43:58.226 INFO:teuthology.orchestra.run.smithi133.stdout:Get:41 http://security.ubuntu.com/ubuntu focal-security/multiverse Translation-en [5,504 B] 2023-09-30T01:43:58.227 INFO:teuthology.orchestra.run.smithi133.stdout:Get:42 http://security.ubuntu.com/ubuntu focal-security/multiverse amd64 c-n-f Metadata [548 B] 2023-09-30T01:43:58.435 INFO:teuthology.orchestra.run.smithi055.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/main i386 Packages [885 kB] 2023-09-30T01:43:58.465 INFO:teuthology.orchestra.run.smithi055.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal-updates/main Translation-en [469 kB] 2023-09-30T01:43:58.478 INFO:teuthology.orchestra.run.smithi055.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 c-n-f Metadata [17.1 kB] 2023-09-30T01:43:58.479 INFO:teuthology.orchestra.run.smithi055.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/restricted i386 Packages [34.7 kB] 2023-09-30T01:43:58.479 INFO:teuthology.orchestra.run.smithi055.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 Packages [2,330 kB] 2023-09-30T01:43:58.539 INFO:teuthology.orchestra.run.smithi055.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/restricted Translation-en [325 kB] 2023-09-30T01:43:58.549 INFO:teuthology.orchestra.run.smithi055.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal-updates/restricted amd64 c-n-f Metadata [572 B] 2023-09-30T01:43:58.723 INFO:teuthology.orchestra.run.smithi055.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal-updates/universe i386 Packages [748 kB] 2023-09-30T01:43:59.311 INFO:teuthology.orchestra.run.smithi055.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 Packages [1,117 kB] 2023-09-30T01:43:59.419 INFO:teuthology.orchestra.run.smithi055.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal-updates/universe Translation-en [267 kB] 2023-09-30T01:43:59.441 INFO:teuthology.orchestra.run.smithi055.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 c-n-f Metadata [25.6 kB] 2023-09-30T01:43:59.442 INFO:teuthology.orchestra.run.smithi055.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/multiverse i386 Packages [8,436 B] 2023-09-30T01:43:59.443 INFO:teuthology.orchestra.run.smithi055.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 Packages [25.9 kB] 2023-09-30T01:43:59.445 INFO:teuthology.orchestra.run.smithi055.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal-updates/multiverse Translation-en [7,484 B] 2023-09-30T01:43:59.446 INFO:teuthology.orchestra.run.smithi055.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal-updates/multiverse amd64 c-n-f Metadata [620 B] 2023-09-30T01:43:59.446 INFO:teuthology.orchestra.run.smithi055.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal-backports/main i386 Packages [36.1 kB] 2023-09-30T01:43:59.448 INFO:teuthology.orchestra.run.smithi055.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 Packages [45.7 kB] 2023-09-30T01:43:59.451 INFO:teuthology.orchestra.run.smithi055.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-backports/main amd64 c-n-f Metadata [1,420 B] 2023-09-30T01:43:59.615 INFO:teuthology.orchestra.run.smithi055.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 Packages [25.0 kB] 2023-09-30T01:43:59.798 INFO:teuthology.orchestra.run.smithi055.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal-backports/universe i386 Packages [13.8 kB] 2023-09-30T01:43:59.820 INFO:teuthology.orchestra.run.smithi055.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal-backports/universe amd64 c-n-f Metadata [880 B] 2023-09-30T01:44:01.884 INFO:teuthology.orchestra.run.smithi055.stdout:Fetched 17.4 MB in 3s (6,684 kB/s) 2023-09-30T01:44:01.904 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 17.4 MB in 3s (6,852 kB/s) 2023-09-30T01:44:03.359 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2023-09-30T01:44:03.386 DEBUG:teuthology.orchestra.run.smithi055:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-30T01:44:03.393 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-09-30T01:44:03.418 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-30T01:44:03.473 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2023-09-30T01:44:03.485 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-09-30T01:44:03.679 INFO:teuthology.orchestra.run.smithi055.stdout:Building dependency tree... 2023-09-30T01:44:03.680 INFO:teuthology.orchestra.run.smithi055.stdout:Reading state information... 2023-09-30T01:44:03.685 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2023-09-30T01:44:03.686 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2023-09-30T01:44:03.873 INFO:teuthology.orchestra.run.smithi055.stdout:The following additional packages will be installed: 2023-09-30T01:44:03.873 INFO:teuthology.orchestra.run.smithi055.stdout: linux-generic linux-headers-5.4.0-163 linux-headers-5.4.0-163-generic 2023-09-30T01:44:03.873 INFO:teuthology.orchestra.run.smithi055.stdout: linux-headers-generic linux-image-5.4.0-163-generic 2023-09-30T01:44:03.873 INFO:teuthology.orchestra.run.smithi055.stdout: linux-modules-5.4.0-163-generic linux-modules-extra-5.4.0-163-generic 2023-09-30T01:44:03.874 INFO:teuthology.orchestra.run.smithi055.stdout:Suggested packages: 2023-09-30T01:44:03.874 INFO:teuthology.orchestra.run.smithi055.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-09-30T01:44:03.874 INFO:teuthology.orchestra.run.smithi055.stdout:Recommended packages: 2023-09-30T01:44:03.874 INFO:teuthology.orchestra.run.smithi055.stdout: thermald 2023-09-30T01:44:03.878 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2023-09-30T01:44:03.878 INFO:teuthology.orchestra.run.smithi133.stdout: linux-generic linux-headers-5.4.0-163 linux-headers-5.4.0-163-generic 2023-09-30T01:44:03.878 INFO:teuthology.orchestra.run.smithi133.stdout: linux-headers-generic linux-image-5.4.0-163-generic 2023-09-30T01:44:03.878 INFO:teuthology.orchestra.run.smithi133.stdout: linux-modules-5.4.0-163-generic linux-modules-extra-5.4.0-163-generic 2023-09-30T01:44:03.879 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2023-09-30T01:44:03.879 INFO:teuthology.orchestra.run.smithi133.stdout: fdutils linux-doc | linux-source-5.4.0 linux-tools 2023-09-30T01:44:03.879 INFO:teuthology.orchestra.run.smithi133.stdout:Recommended packages: 2023-09-30T01:44:03.879 INFO:teuthology.orchestra.run.smithi133.stdout: thermald 2023-09-30T01:44:03.937 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2023-09-30T01:44:03.937 INFO:teuthology.orchestra.run.smithi133.stdout: linux-headers-5.4.0-163 linux-headers-5.4.0-163-generic 2023-09-30T01:44:03.937 INFO:teuthology.orchestra.run.smithi133.stdout: linux-image-5.4.0-163-generic linux-modules-5.4.0-163-generic 2023-09-30T01:44:03.937 INFO:teuthology.orchestra.run.smithi133.stdout: linux-modules-extra-5.4.0-163-generic 2023-09-30T01:44:03.938 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages will be upgraded: 2023-09-30T01:44:03.939 INFO:teuthology.orchestra.run.smithi133.stdout: linux-generic linux-headers-generic linux-image-generic 2023-09-30T01:44:03.952 INFO:teuthology.orchestra.run.smithi055.stdout:The following NEW packages will be installed: 2023-09-30T01:44:03.952 INFO:teuthology.orchestra.run.smithi055.stdout: linux-headers-5.4.0-163 linux-headers-5.4.0-163-generic 2023-09-30T01:44:03.952 INFO:teuthology.orchestra.run.smithi055.stdout: linux-image-5.4.0-163-generic linux-modules-5.4.0-163-generic 2023-09-30T01:44:03.952 INFO:teuthology.orchestra.run.smithi055.stdout: linux-modules-extra-5.4.0-163-generic 2023-09-30T01:44:03.953 INFO:teuthology.orchestra.run.smithi055.stdout:The following packages will be upgraded: 2023-09-30T01:44:03.954 INFO:teuthology.orchestra.run.smithi055.stdout: linux-generic linux-headers-generic linux-image-generic 2023-09-30T01:44:04.010 INFO:teuthology.orchestra.run.smithi055.stdout:3 upgraded, 5 newly installed, 0 to remove and 263 not upgraded. 2023-09-30T01:44:04.010 INFO:teuthology.orchestra.run.smithi055.stdout:Need to get 77.1 MB of archives. 2023-09-30T01:44:04.010 INFO:teuthology.orchestra.run.smithi055.stdout:After this operation, 380 MB of additional disk space will be used. 2023-09-30T01:44:04.010 INFO:teuthology.orchestra.run.smithi055.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-163-generic amd64 5.4.0-163.180 [15.0 MB] 2023-09-30T01:44:04.122 INFO:teuthology.orchestra.run.smithi133.stdout:3 upgraded, 5 newly installed, 0 to remove and 263 not upgraded. 2023-09-30T01:44:04.123 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 77.1 MB of archives. 2023-09-30T01:44:04.123 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 380 MB of additional disk space will be used. 2023-09-30T01:44:04.123 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-5.4.0-163-generic amd64 5.4.0-163.180 [15.0 MB] 2023-09-30T01:44:04.453 INFO:teuthology.orchestra.run.smithi055.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-163-generic amd64 5.4.0-163.180 [10.5 MB] 2023-09-30T01:44:04.575 INFO:teuthology.orchestra.run.smithi055.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-163-generic amd64 5.4.0-163.180 [39.2 MB] 2023-09-30T01:44:05.239 INFO:teuthology.orchestra.run.smithi055.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.163.160 [1,904 B] 2023-09-30T01:44:05.240 INFO:teuthology.orchestra.run.smithi055.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.163.160 [2,604 B] 2023-09-30T01:44:05.240 INFO:teuthology.orchestra.run.smithi055.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-163 all 5.4.0-163.180 [11.0 MB] 2023-09-30T01:44:05.293 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-5.4.0-163-generic amd64 5.4.0-163.180 [10.5 MB] 2023-09-30T01:44:05.447 INFO:teuthology.orchestra.run.smithi055.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-163-generic amd64 5.4.0-163.180 [1,358 kB] 2023-09-30T01:44:05.483 INFO:teuthology.orchestra.run.smithi055.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.163.160 [2,468 B] 2023-09-30T01:44:05.564 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-modules-extra-5.4.0-163-generic amd64 5.4.0-163.180 [39.2 MB] 2023-09-30T01:44:06.199 INFO:teuthology.orchestra.run.smithi055.stdout:Fetched 77.1 MB in 2s (50.6 MB/s) 2023-09-30T01:44:06.403 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package linux-modules-5.4.0-163-generic. 2023-09-30T01:44:06.800 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-generic amd64 5.4.0.163.160 [1,904 B] 2023-09-30T01:44:06.800 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-image-generic amd64 5.4.0.163.160 [2,604 B] 2023-09-30T01:44:06.800 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-163 all 5.4.0-163.180 [11.0 MB] 2023-09-30T01:44:07.085 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-5.4.0-163-generic amd64 5.4.0-163.180 [1,358 kB] 2023-09-30T01:44:07.127 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 linux-headers-generic amd64 5.4.0.163.160 [2,468 B] 2023-09-30T01:44:07.848 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 77.1 MB in 3s (24.2 MB/s) 2023-09-30T01:44:08.063 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-modules-5.4.0-163-generic. 2023-09-30T01:44:08.189 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-09-30T01:44:08.194 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../0-linux-modules-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-30T01:44:08.318 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking linux-modules-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:09.860 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 104373 files and directories currently installed.) 2023-09-30T01:44:09.865 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../0-linux-modules-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-30T01:44:10.026 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-modules-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:10.462 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package linux-image-5.4.0-163-generic. 2023-09-30T01:44:10.476 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../1-linux-image-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-30T01:44:10.583 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking linux-image-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:11.699 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-163-generic. 2023-09-30T01:44:11.712 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-30T01:44:11.749 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking linux-modules-extra-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:11.987 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-image-5.4.0-163-generic. 2023-09-30T01:44:12.000 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../1-linux-image-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-30T01:44:12.096 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-image-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:13.198 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-modules-extra-5.4.0-163-generic. 2023-09-30T01:44:13.211 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../2-linux-modules-extra-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-30T01:44:13.256 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-modules-extra-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:16.673 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../3-linux-generic_5.4.0.163.160_amd64.deb ... 2023-09-30T01:44:16.808 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking linux-generic (5.4.0.163.160) over (5.4.0.124.125) ... 2023-09-30T01:44:17.175 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.163.160_amd64.deb ... 2023-09-30T01:44:17.312 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking linux-image-generic (5.4.0.163.160) over (5.4.0.124.125) ... 2023-09-30T01:44:17.656 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package linux-headers-5.4.0-163. 2023-09-30T01:44:17.673 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../5-linux-headers-5.4.0-163_5.4.0-163.180_all.deb ... 2023-09-30T01:44:17.714 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking linux-headers-5.4.0-163 (5.4.0-163.180) ... 2023-09-30T01:44:18.499 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../3-linux-generic_5.4.0.163.160_amd64.deb ... 2023-09-30T01:44:18.627 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-generic (5.4.0.163.160) over (5.4.0.124.125) ... 2023-09-30T01:44:19.020 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../4-linux-image-generic_5.4.0.163.160_amd64.deb ... 2023-09-30T01:44:19.147 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-image-generic (5.4.0.163.160) over (5.4.0.124.125) ... 2023-09-30T01:44:19.500 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-headers-5.4.0-163. 2023-09-30T01:44:19.518 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../5-linux-headers-5.4.0-163_5.4.0-163.180_all.deb ... 2023-09-30T01:44:19.550 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-headers-5.4.0-163 (5.4.0-163.180) ... 2023-09-30T01:44:23.831 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package linux-headers-5.4.0-163-generic. 2023-09-30T01:44:23.852 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../6-linux-headers-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-30T01:44:23.889 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking linux-headers-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:25.169 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package linux-headers-5.4.0-163-generic. 2023-09-30T01:44:25.190 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../6-linux-headers-5.4.0-163-generic_5.4.0-163.180_amd64.deb ... 2023-09-30T01:44:25.261 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-headers-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:26.571 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.163.160_amd64.deb ... 2023-09-30T01:44:26.692 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking linux-headers-generic (5.4.0.163.160) over (5.4.0.124.125) ... 2023-09-30T01:44:27.036 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up linux-modules-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:28.041 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../7-linux-headers-generic_5.4.0.163.160_amd64.deb ... 2023-09-30T01:44:28.185 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking linux-headers-generic (5.4.0.163.160) over (5.4.0.124.125) ... 2023-09-30T01:44:28.377 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up linux-headers-5.4.0-163 (5.4.0-163.180) ... 2023-09-30T01:44:28.956 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-modules-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:29.143 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up linux-image-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:30.191 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-headers-5.4.0-163 (5.4.0-163.180) ... 2023-09-30T01:44:30.333 INFO:teuthology.orchestra.run.smithi055.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-163-generic 2023-09-30T01:44:30.333 INFO:teuthology.orchestra.run.smithi055.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-163-generic 2023-09-30T01:44:30.334 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-image-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:30.470 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up linux-headers-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:30.597 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up linux-modules-extra-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:31.514 INFO:teuthology.orchestra.run.smithi133.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.4.0-163-generic 2023-09-30T01:44:31.514 INFO:teuthology.orchestra.run.smithi133.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.4.0-163-generic 2023-09-30T01:44:31.694 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-headers-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:31.815 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up linux-image-generic (5.4.0.163.160) ... 2023-09-30T01:44:31.837 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-modules-extra-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:31.941 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up linux-headers-generic (5.4.0.163.160) ... 2023-09-30T01:44:32.067 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up linux-generic (5.4.0.163.160) ... 2023-09-30T01:44:32.211 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for linux-image-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:32.292 INFO:teuthology.orchestra.run.smithi055.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-09-30T01:44:32.292 INFO:teuthology.orchestra.run.smithi055.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-163-generic 2023-09-30T01:44:32.997 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-image-generic (5.4.0.163.160) ... 2023-09-30T01:44:33.139 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-headers-generic (5.4.0.163.160) ... 2023-09-30T01:44:33.265 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up linux-generic (5.4.0.163.160) ... 2023-09-30T01:44:33.417 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for linux-image-5.4.0-163-generic (5.4.0-163.180) ... 2023-09-30T01:44:33.489 INFO:teuthology.orchestra.run.smithi133.stdout:/etc/kernel/postinst.d/initramfs-tools: 2023-09-30T01:44:33.489 INFO:teuthology.orchestra.run.smithi133.stdout:update-initramfs: Generating /boot/initrd.img-5.4.0-163-generic 2023-09-30T01:44:55.194 INFO:teuthology.orchestra.run.smithi055.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-09-30T01:44:55.195 INFO:teuthology.orchestra.run.smithi055.stdout:Sourcing file `/etc/default/grub' 2023-09-30T01:44:55.208 INFO:teuthology.orchestra.run.smithi055.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-30T01:44:55.218 INFO:teuthology.orchestra.run.smithi055.stdout:Generating grub configuration file ... 2023-09-30T01:44:55.623 INFO:teuthology.orchestra.run.smithi055.stdout:Found linux image: /boot/vmlinuz-5.4.0-163-generic 2023-09-30T01:44:55.635 INFO:teuthology.orchestra.run.smithi133.stdout:/etc/kernel/postinst.d/zz-update-grub: 2023-09-30T01:44:55.635 INFO:teuthology.orchestra.run.smithi133.stdout:Sourcing file `/etc/default/grub' 2023-09-30T01:44:55.644 INFO:teuthology.orchestra.run.smithi133.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-30T01:44:55.648 INFO:teuthology.orchestra.run.smithi055.stdout:Found initrd image: /boot/initrd.img-5.4.0-163-generic 2023-09-30T01:44:55.662 INFO:teuthology.orchestra.run.smithi133.stdout:Generating grub configuration file ... 2023-09-30T01:44:56.059 INFO:teuthology.orchestra.run.smithi055.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-09-30T01:44:56.061 INFO:teuthology.orchestra.run.smithi133.stdout:Found linux image: /boot/vmlinuz-5.4.0-163-generic 2023-09-30T01:44:56.071 INFO:teuthology.orchestra.run.smithi055.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-09-30T01:44:56.091 INFO:teuthology.orchestra.run.smithi133.stdout:Found initrd image: /boot/initrd.img-5.4.0-163-generic 2023-09-30T01:44:56.584 INFO:teuthology.orchestra.run.smithi133.stdout:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-09-30T01:44:56.596 INFO:teuthology.orchestra.run.smithi133.stdout:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-09-30T01:44:58.058 INFO:teuthology.orchestra.run.smithi055.stdout:done 2023-09-30T01:44:58.512 DEBUG:teuthology.orchestra.run.smithi055:> dpkg -s linux-image-generic 2023-09-30T01:44:58.565 INFO:teuthology.orchestra.run.smithi055.stdout:Package: linux-image-generic 2023-09-30T01:44:58.565 INFO:teuthology.orchestra.run.smithi055.stdout:Status: install ok installed 2023-09-30T01:44:58.565 INFO:teuthology.orchestra.run.smithi055.stdout:Priority: optional 2023-09-30T01:44:58.565 INFO:teuthology.orchestra.run.smithi055.stdout:Section: kernel 2023-09-30T01:44:58.565 INFO:teuthology.orchestra.run.smithi055.stdout:Installed-Size: 20 2023-09-30T01:44:58.566 INFO:teuthology.orchestra.run.smithi055.stdout:Maintainer: Ubuntu Kernel Team 2023-09-30T01:44:58.566 INFO:teuthology.orchestra.run.smithi055.stdout:Architecture: amd64 2023-09-30T01:44:58.566 INFO:teuthology.orchestra.run.smithi055.stdout:Source: linux-meta 2023-09-30T01:44:58.566 INFO:teuthology.orchestra.run.smithi055.stdout:Version: 5.4.0.163.160 2023-09-30T01:44:58.566 INFO:teuthology.orchestra.run.smithi055.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-09-30T01:44:58.566 INFO:teuthology.orchestra.run.smithi055.stdout:Depends: linux-image-5.4.0-163-generic, linux-modules-extra-5.4.0-163-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-30T01:44:58.566 INFO:teuthology.orchestra.run.smithi055.stdout:Recommends: thermald 2023-09-30T01:44:58.566 INFO:teuthology.orchestra.run.smithi055.stdout:Description: Generic Linux kernel image 2023-09-30T01:44:58.566 INFO:teuthology.orchestra.run.smithi055.stdout: This package will always depend on the latest generic kernel image 2023-09-30T01:44:58.566 INFO:teuthology.orchestra.run.smithi055.stdout: available. 2023-09-30T01:44:58.567 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-163-generic 2023-09-30T01:44:58.567 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-30T01:44:58.567 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-30T01:44:58.567 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2023-09-30T01:44:58.567 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi055.front.sepia.ceph.com, path=None, version=distro) 2023-09-30T01:44:58.567 DEBUG:teuthology.orchestra.run.smithi055:> sudo apt-get clean 2023-09-30T01:44:58.622 INFO:teuthology.orchestra.run.smithi133.stdout:done 2023-09-30T01:44:58.636 DEBUG:teuthology.orchestra.run.smithi055:> sudo apt-get update 2023-09-30T01:44:58.901 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-09-30T01:44:58.901 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:2 http://archive.ubuntu.com/ubuntu focal InRelease 2023-09-30T01:44:58.972 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-09-30T01:44:59.053 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-09-30T01:44:59.077 DEBUG:teuthology.orchestra.run.smithi133:> dpkg -s linux-image-generic 2023-09-30T01:44:59.119 INFO:teuthology.orchestra.run.smithi133.stdout:Package: linux-image-generic 2023-09-30T01:44:59.119 INFO:teuthology.orchestra.run.smithi133.stdout:Status: install ok installed 2023-09-30T01:44:59.119 INFO:teuthology.orchestra.run.smithi133.stdout:Priority: optional 2023-09-30T01:44:59.119 INFO:teuthology.orchestra.run.smithi133.stdout:Section: kernel 2023-09-30T01:44:59.120 INFO:teuthology.orchestra.run.smithi133.stdout:Installed-Size: 20 2023-09-30T01:44:59.120 INFO:teuthology.orchestra.run.smithi133.stdout:Maintainer: Ubuntu Kernel Team 2023-09-30T01:44:59.120 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: amd64 2023-09-30T01:44:59.120 INFO:teuthology.orchestra.run.smithi133.stdout:Source: linux-meta 2023-09-30T01:44:59.120 INFO:teuthology.orchestra.run.smithi133.stdout:Version: 5.4.0.163.160 2023-09-30T01:44:59.120 INFO:teuthology.orchestra.run.smithi133.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-09-30T01:44:59.120 INFO:teuthology.orchestra.run.smithi133.stdout:Depends: linux-image-5.4.0-163-generic, linux-modules-extra-5.4.0-163-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-30T01:44:59.120 INFO:teuthology.orchestra.run.smithi133.stdout:Recommends: thermald 2023-09-30T01:44:59.120 INFO:teuthology.orchestra.run.smithi133.stdout:Description: Generic Linux kernel image 2023-09-30T01:44:59.120 INFO:teuthology.orchestra.run.smithi133.stdout: This package will always depend on the latest generic kernel image 2023-09-30T01:44:59.120 INFO:teuthology.orchestra.run.smithi133.stdout: available. 2023-09-30T01:44:59.121 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.4.0-124-generic Expected: 5.4.0-163-generic 2023-09-30T01:44:59.121 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-09-30T01:44:59.121 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-09-30T01:44:59.121 INFO:teuthology.task.kernel:Installing distro kernel on mgr.y... 2023-09-30T01:44:59.121 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi133.front.sepia.ceph.com, path=None, version=distro) 2023-09-30T01:44:59.121 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get clean 2023-09-30T01:44:59.242 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2023-09-30T01:44:59.376 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:1 http://archive.ubuntu.com/ubuntu focal InRelease 2023-09-30T01:44:59.376 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:2 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-09-30T01:44:59.381 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-09-30T01:44:59.398 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-09-30T01:45:00.716 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2023-09-30T01:45:00.743 DEBUG:teuthology.orchestra.run.smithi055:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-30T01:45:00.809 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2023-09-30T01:45:01.013 INFO:teuthology.orchestra.run.smithi055.stdout:Building dependency tree... 2023-09-30T01:45:01.014 INFO:teuthology.orchestra.run.smithi055.stdout:Reading state information... 2023-09-30T01:45:01.109 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-09-30T01:45:01.135 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2023-09-30T01:45:01.207 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-09-30T01:45:01.248 INFO:teuthology.orchestra.run.smithi055.stdout:linux-image-generic is already the newest version (5.4.0.163.160). 2023-09-30T01:45:01.248 INFO:teuthology.orchestra.run.smithi055.stdout:0 upgraded, 0 newly installed, 0 to remove and 263 not upgraded. 2023-09-30T01:45:01.250 DEBUG:teuthology.orchestra.run.smithi055:> dpkg -s linux-image-generic 2023-09-30T01:45:01.270 INFO:teuthology.orchestra.run.smithi055.stdout:Package: linux-image-generic 2023-09-30T01:45:01.271 INFO:teuthology.orchestra.run.smithi055.stdout:Status: install ok installed 2023-09-30T01:45:01.271 INFO:teuthology.orchestra.run.smithi055.stdout:Priority: optional 2023-09-30T01:45:01.271 INFO:teuthology.orchestra.run.smithi055.stdout:Section: kernel 2023-09-30T01:45:01.271 INFO:teuthology.orchestra.run.smithi055.stdout:Installed-Size: 20 2023-09-30T01:45:01.271 INFO:teuthology.orchestra.run.smithi055.stdout:Maintainer: Ubuntu Kernel Team 2023-09-30T01:45:01.271 INFO:teuthology.orchestra.run.smithi055.stdout:Architecture: amd64 2023-09-30T01:45:01.271 INFO:teuthology.orchestra.run.smithi055.stdout:Source: linux-meta 2023-09-30T01:45:01.271 INFO:teuthology.orchestra.run.smithi055.stdout:Version: 5.4.0.163.160 2023-09-30T01:45:01.271 INFO:teuthology.orchestra.run.smithi055.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-09-30T01:45:01.272 INFO:teuthology.orchestra.run.smithi055.stdout:Depends: linux-image-5.4.0-163-generic, linux-modules-extra-5.4.0-163-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-30T01:45:01.272 INFO:teuthology.orchestra.run.smithi055.stdout:Recommends: thermald 2023-09-30T01:45:01.272 INFO:teuthology.orchestra.run.smithi055.stdout:Description: Generic Linux kernel image 2023-09-30T01:45:01.272 INFO:teuthology.orchestra.run.smithi055.stdout: This package will always depend on the latest generic kernel image 2023-09-30T01:45:01.272 INFO:teuthology.orchestra.run.smithi055.stdout: available. 2023-09-30T01:45:01.272 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2023-09-30T01:45:01.276 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.OgpEszyN1l 2023-09-30T01:45:01.277 DEBUG:teuthology.orchestra.run.smithi055:> sudo cp /boot/grub/grub.cfg /tmp/tmp.OgpEszyN1l 2023-09-30T01:45:01.289 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.OgpEszyN1l 2023-09-30T01:45:01.376 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.OgpEszyN1l is 9KB 2023-09-30T01:45:01.390 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.OgpEszyN1l 2023-09-30T01:45:01.396 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-09-30T01:45:01.411 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2023-09-30T01:45:01.412 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2023-09-30T01:45:01.451 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:45:01.451 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-09-30T01:45:01.451 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-09-30T01:45:01.494 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-163-generic 2023-09-30T01:45:01.495 DEBUG:teuthology.orchestra.run.smithi055:> sudo update-grub 2023-09-30T01:45:01.627 INFO:teuthology.orchestra.run.smithi133.stdout:linux-image-generic is already the newest version (5.4.0.163.160). 2023-09-30T01:45:01.628 INFO:teuthology.orchestra.run.smithi133.stdout:0 upgraded, 0 newly installed, 0 to remove and 263 not upgraded. 2023-09-30T01:45:01.629 DEBUG:teuthology.orchestra.run.smithi133:> dpkg -s linux-image-generic 2023-09-30T01:45:01.650 INFO:teuthology.orchestra.run.smithi133.stdout:Package: linux-image-generic 2023-09-30T01:45:01.651 INFO:teuthology.orchestra.run.smithi133.stdout:Status: install ok installed 2023-09-30T01:45:01.651 INFO:teuthology.orchestra.run.smithi133.stdout:Priority: optional 2023-09-30T01:45:01.651 INFO:teuthology.orchestra.run.smithi133.stdout:Section: kernel 2023-09-30T01:45:01.651 INFO:teuthology.orchestra.run.smithi133.stdout:Installed-Size: 20 2023-09-30T01:45:01.651 INFO:teuthology.orchestra.run.smithi133.stdout:Maintainer: Ubuntu Kernel Team 2023-09-30T01:45:01.651 INFO:teuthology.orchestra.run.smithi133.stdout:Architecture: amd64 2023-09-30T01:45:01.651 INFO:teuthology.orchestra.run.smithi133.stdout:Source: linux-meta 2023-09-30T01:45:01.651 INFO:teuthology.orchestra.run.smithi133.stdout:Version: 5.4.0.163.160 2023-09-30T01:45:01.652 INFO:teuthology.orchestra.run.smithi133.stdout:Provides: virtualbox-guest-modules (= 6.1.38-dfsg-3~ubuntu1.20.04.1), wireguard-modules (= 1.0.20201112-1~20.04.1), zfs-modules (= 0.8.3-1ubuntu12.15) 2023-09-30T01:45:01.652 INFO:teuthology.orchestra.run.smithi133.stdout:Depends: linux-image-5.4.0-163-generic, linux-modules-extra-5.4.0-163-generic, linux-firmware, intel-microcode, amd64-microcode 2023-09-30T01:45:01.652 INFO:teuthology.orchestra.run.smithi133.stdout:Recommends: thermald 2023-09-30T01:45:01.652 INFO:teuthology.orchestra.run.smithi133.stdout:Description: Generic Linux kernel image 2023-09-30T01:45:01.652 INFO:teuthology.orchestra.run.smithi133.stdout: This package will always depend on the latest generic kernel image 2023-09-30T01:45:01.652 INFO:teuthology.orchestra.run.smithi133.stdout: available. 2023-09-30T01:45:01.652 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-09-30T01:45:01.700 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.CubeFW0E5I 2023-09-30T01:45:01.700 DEBUG:teuthology.orchestra.run.smithi133:> sudo cp /boot/grub/grub.cfg /tmp/tmp.CubeFW0E5I 2023-09-30T01:45:01.727 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.CubeFW0E5I 2023-09-30T01:45:01.764 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.CubeFW0E5I is 9KB 2023-09-30T01:45:01.778 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.CubeFW0E5I 2023-09-30T01:45:01.785 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2023-09-30T01:45:01.843 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:45:01.843 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/grub.d/01_ceph_kernel 2023-09-30T01:45:01.843 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2023-09-30T01:45:01.876 INFO:teuthology.task.kernel:Distro Kernel Version: 5.4.0-163-generic 2023-09-30T01:45:01.876 DEBUG:teuthology.orchestra.run.smithi133:> sudo update-grub 2023-09-30T01:45:02.900 INFO:teuthology.orchestra.run.smithi055.stderr:Sourcing file `/etc/default/grub' 2023-09-30T01:45:02.907 INFO:teuthology.orchestra.run.smithi055.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-30T01:45:02.915 INFO:teuthology.orchestra.run.smithi055.stderr:Generating grub configuration file ... 2023-09-30T01:45:03.184 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-5.4.0-163-generic 2023-09-30T01:45:03.196 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-5.4.0-163-generic 2023-09-30T01:45:03.254 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub' 2023-09-30T01:45:03.260 INFO:teuthology.orchestra.run.smithi133.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2023-09-30T01:45:03.269 INFO:teuthology.orchestra.run.smithi133.stderr:Generating grub configuration file ... 2023-09-30T01:45:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-09-30T01:45:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-09-30T01:45:03.609 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.4.0-163-generic 2023-09-30T01:45:03.621 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.4.0-163-generic 2023-09-30T01:45:04.068 INFO:teuthology.orchestra.run.smithi133.stderr:Found linux image: /boot/vmlinuz-5.4.0-124-generic 2023-09-30T01:45:04.079 INFO:teuthology.orchestra.run.smithi133.stderr:Found initrd image: /boot/initrd.img-5.4.0-124-generic 2023-09-30T01:45:04.617 INFO:teuthology.orchestra.run.smithi055.stderr:done 2023-09-30T01:45:04.619 DEBUG:teuthology.orchestra.run.smithi055:> sudo shutdown -r now 2023-09-30T01:45:05.021 INFO:teuthology.orchestra.run.smithi133.stderr:done 2023-09-30T01:45:05.023 DEBUG:teuthology.orchestra.run.smithi133:> sudo shutdown -r now 2023-09-30T01:45:34.650 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2023-09-30T01:45:34.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-09-30T01:45:34.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T01:45:35.069 INFO:teuthology.task.kernel:Checking client mgr.y for new kernel version... 2023-09-30T01:45:35.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-09-30T01:45:35.070 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T01:45:53.022 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.55 2023-09-30T01:45:53.530 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-09-30T01:46:02.030 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-09-30T01:46:02.031 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T01:46:02.531 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-09-30T01:46:02.532 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T01:46:05.594 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-09-30T01:46:17.606 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-09-30T01:46:17.607 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T01:46:36.026 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.133 2023-09-30T01:46:51.038 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-09-30T01:46:51.039 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T01:46:51.407 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-09-30T01:46:52.105 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-09-30T01:46:52.105 INFO:teuthology.task.kernel:Checking kernel version of mgr.y, want "5.4.0-163-generic"... 2023-09-30T01:46:52.105 DEBUG:teuthology.orchestra.run.smithi133:> uname -r 2023-09-30T01:46:52.111 INFO:teuthology.orchestra.run.smithi133.stdout:5.4.0-163-generic 2023-09-30T01:46:52.112 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-163-generic vs 5.4.0-163-generic 2023-09-30T01:46:52.112 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T01:46:52.112 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-09-30T01:46:53.113 INFO:teuthology.task.kernel:Enabling kdb on mgr.y... 2023-09-30T01:46:53.113 DEBUG:teuthology.orchestra.run.smithi133:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T01:46:53.207 INFO:teuthology.orchestra.run.smithi133.stdout:ttyS1 2023-09-30T01:46:53.235 DEBUG:teuthology.parallel:result is None 2023-09-30T01:47:02.032 DEBUG:teuthology.orchestra.remote:timed out 2023-09-30T01:47:14.034 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-09-30T01:47:14.034 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T01:47:14.228 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-09-30T01:47:14.805 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-09-30T01:47:14.805 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.4.0-163-generic"... 2023-09-30T01:47:14.805 DEBUG:teuthology.orchestra.run.smithi055:> uname -r 2023-09-30T01:47:14.811 INFO:teuthology.orchestra.run.smithi055.stdout:5.4.0-163-generic 2023-09-30T01:47:14.812 DEBUG:teuthology.task.kernel:current kernel version is 5.4.0-163-generic vs 5.4.0-163-generic 2023-09-30T01:47:14.812 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-09-30T01:47:14.812 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2023-09-30T01:47:15.813 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2023-09-30T01:47:15.813 DEBUG:teuthology.orchestra.run.smithi055:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-09-30T01:47:15.887 INFO:teuthology.orchestra.run.smithi055.stdout:ttyS1 2023-09-30T01:47:15.902 DEBUG:teuthology.parallel:result is None 2023-09-30T01:47:15.903 INFO:teuthology.run_tasks:Running task internal.base... 2023-09-30T01:47:15.910 INFO:teuthology.task.internal:Creating test directory... 2023-09-30T01:47:15.910 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T01:47:15.912 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-09-30T01:47:15.920 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-09-30T01:47:15.972 INFO:teuthology.run_tasks:Running task internal.archive... 2023-09-30T01:47:16.022 INFO:teuthology.task.internal:Creating archive directory... 2023-09-30T01:47:16.023 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T01:47:16.025 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-09-30T01:47:16.046 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-09-30T01:47:16.072 INFO:teuthology.task.internal:Enabling coredump saving... 2023-09-30T01:47:16.072 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T01:47:16.085 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-09-30T01:47:16.100 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T01:47:16.108 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T01:47:16.110 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T01:47:16.117 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-09-30T01:47:16.119 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-09-30T01:47:16.126 INFO:teuthology.task.internal:Configuring sudo... 2023-09-30T01:47:16.127 DEBUG:teuthology.orchestra.run.smithi055:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T01:47:16.129 DEBUG:teuthology.orchestra.run.smithi133:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-09-30T01:47:16.145 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-09-30T01:47:16.173 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-09-30T01:47:16.173 DEBUG:teuthology.orchestra.run.smithi055:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T01:47:16.185 DEBUG:teuthology.orchestra.run.smithi133:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-09-30T01:47:16.192 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T01:47:16.199 DEBUG:teuthology.orchestra.run.smithi055:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T01:47:16.205 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:47:16.205 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T01:47:16.266 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-09-30T01:47:16.273 DEBUG:teuthology.orchestra.run.smithi133:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-09-30T01:47:16.281 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:47:16.281 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-09-30T01:47:16.300 DEBUG:teuthology.orchestra.run.smithi055:> sudo service rsyslog restart 2023-09-30T01:47:16.302 DEBUG:teuthology.orchestra.run.smithi133:> sudo service rsyslog restart 2023-09-30T01:47:16.393 INFO:teuthology.run_tasks:Running task internal.timer... 2023-09-30T01:47:16.401 INFO:teuthology.task.internal:Starting timer... 2023-09-30T01:47:16.401 INFO:teuthology.run_tasks:Running task pcp... 2023-09-30T01:47:16.442 INFO:teuthology.run_tasks:Running task selinux... 2023-09-30T01:47:16.492 DEBUG:teuthology.task.selinux:Excluding smithi055: OS 'ubuntu' does not support SELinux 2023-09-30T01:47:16.492 DEBUG:teuthology.task.selinux:Excluding smithi133: OS 'ubuntu' does not support SELinux 2023-09-30T01:47:16.492 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-09-30T01:47:16.492 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2023-09-30T01:47:16.493 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-09-30T01:47:16.493 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-09-30T01:47:16.548 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-09-30T01:47:16.549 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-09-30T01:47:16.568 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-09-30T01:47:16.570 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi055.front.sepia.ceph.com,smithi133.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-09-30T01:53:04.511 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi055.front.sepia.ceph.com'), Remote(name='ubuntu@smithi133.front.sepia.ceph.com')] 2023-09-30T01:53:04.513 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-09-30T01:53:04.514 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi055.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T01:53:04.562 DEBUG:teuthology.orchestra.run.smithi055:> true 2023-09-30T01:53:04.684 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi055.front.sepia.ceph.com' 2023-09-30T01:53:04.685 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-09-30T01:53:04.685 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi133.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-09-30T01:53:04.733 DEBUG:teuthology.orchestra.run.smithi133:> true 2023-09-30T01:53:04.852 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi133.front.sepia.ceph.com' 2023-09-30T01:53:04.853 INFO:teuthology.run_tasks:Running task clock... 2023-09-30T01:53:04.866 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-09-30T01:53:04.866 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T01:53:04.867 DEBUG:teuthology.orchestra.run.smithi055:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T01:53:04.869 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-09-30T01:53:04.869 DEBUG:teuthology.orchestra.run.smithi133:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T01:53:04.901 INFO:teuthology.orchestra.run.smithi055.stdout:30 Sep 01:53:04 ntpd[22623]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-09-30T01:53:04.901 INFO:teuthology.orchestra.run.smithi055.stdout:30 Sep 01:53:04 ntpd[22623]: Command line: ntpd -gq 2023-09-30T01:53:04.902 INFO:teuthology.orchestra.run.smithi055.stdout:30 Sep 01:53:04 ntpd[22623]: proto: precision = 0.072 usec (-24) 2023-09-30T01:53:04.902 INFO:teuthology.orchestra.run.smithi055.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-30T01:53:04.902 INFO:teuthology.orchestra.run.smithi055.stdout:30 Sep 01:53:04 ntpd[22623]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-30T01:53:04.902 INFO:teuthology.orchestra.run.smithi055.stdout:30 Sep 01:53:04 ntpd[22623]: restrict ::: KOD does nothing without LIMITED. 2023-09-30T01:53:04.903 INFO:teuthology.orchestra.run.smithi055.stderr:restrict ::: KOD does nothing without LIMITED. 2023-09-30T01:53:04.903 INFO:teuthology.orchestra.run.smithi055.stdout:30 Sep 01:53:04 ntpd[22623]: Listen and drop on 0 v6wildcard [::]:123 2023-09-30T01:53:04.904 INFO:teuthology.orchestra.run.smithi055.stdout:30 Sep 01:53:04 ntpd[22623]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-09-30T01:53:04.904 INFO:teuthology.orchestra.run.smithi055.stdout:30 Sep 01:53:04 ntpd[22623]: Listen normally on 2 lo 127.0.0.1:123 2023-09-30T01:53:04.904 INFO:teuthology.orchestra.run.smithi055.stdout:30 Sep 01:53:04 ntpd[22623]: Listen normally on 3 ens1f0 172.21.15.55:123 2023-09-30T01:53:04.904 INFO:teuthology.orchestra.run.smithi055.stdout:30 Sep 01:53:04 ntpd[22623]: Listen normally on 4 lo [::1]:123 2023-09-30T01:53:04.904 INFO:teuthology.orchestra.run.smithi055.stdout:30 Sep 01:53:04 ntpd[22623]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fef8:2606%3]:123 2023-09-30T01:53:04.904 INFO:teuthology.orchestra.run.smithi055.stdout:30 Sep 01:53:04 ntpd[22623]: Listening on routing socket on fd #22 for interface updates 2023-09-30T01:53:04.906 INFO:teuthology.orchestra.run.smithi133.stdout:30 Sep 01:53:04 ntpd[22689]: ntpd 4.2.8p12@1.3728-o (1): Starting 2023-09-30T01:53:04.907 INFO:teuthology.orchestra.run.smithi133.stdout:30 Sep 01:53:04 ntpd[22689]: Command line: ntpd -gq 2023-09-30T01:53:04.908 INFO:teuthology.orchestra.run.smithi133.stdout:30 Sep 01:53:04 ntpd[22689]: proto: precision = 0.117 usec (-23) 2023-09-30T01:53:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-30T01:53:04.909 INFO:teuthology.orchestra.run.smithi133.stdout:30 Sep 01:53:04 ntpd[22689]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2023-09-30T01:53:04.909 INFO:teuthology.orchestra.run.smithi133.stderr:restrict ::: KOD does nothing without LIMITED. 2023-09-30T01:53:04.910 INFO:teuthology.orchestra.run.smithi133.stdout:30 Sep 01:53:04 ntpd[22689]: restrict ::: KOD does nothing without LIMITED. 2023-09-30T01:53:04.910 INFO:teuthology.orchestra.run.smithi133.stdout:30 Sep 01:53:04 ntpd[22689]: Listen and drop on 0 v6wildcard [::]:123 2023-09-30T01:53:04.910 INFO:teuthology.orchestra.run.smithi133.stdout:30 Sep 01:53:04 ntpd[22689]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2023-09-30T01:53:04.910 INFO:teuthology.orchestra.run.smithi133.stdout:30 Sep 01:53:04 ntpd[22689]: Listen normally on 2 lo 127.0.0.1:123 2023-09-30T01:53:04.911 INFO:teuthology.orchestra.run.smithi133.stdout:30 Sep 01:53:04 ntpd[22689]: Listen normally on 3 enp3s0f1 172.21.15.133:123 2023-09-30T01:53:04.911 INFO:teuthology.orchestra.run.smithi133.stdout:30 Sep 01:53:04 ntpd[22689]: Listen normally on 4 lo [::1]:123 2023-09-30T01:53:04.911 INFO:teuthology.orchestra.run.smithi133.stdout:30 Sep 01:53:04 ntpd[22689]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:8087%5]:123 2023-09-30T01:53:04.913 INFO:teuthology.orchestra.run.smithi133.stdout:30 Sep 01:53:04 ntpd[22689]: Listening on routing socket on fd #22 for interface updates 2023-09-30T01:53:05.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:05 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:05.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:05 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:05.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:05 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:05.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:05 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:05.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:05 ntpd[22623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:05.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:05 ntpd[22623]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:05.907 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:05 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:05.907 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:05 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:05.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:05 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:05.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:05 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:05.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:05 ntpd[22689]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:05.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:05 ntpd[22689]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:06.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:06 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:06.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:06 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:06.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:06 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:06.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:06 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:06.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:06 ntpd[22623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:06.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:06 ntpd[22623]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:07.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:07 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:07.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:07 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:07.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:07 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:07.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:07 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:07.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:07 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:07.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:07 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:07.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:07 ntpd[22623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:07.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:07 ntpd[22623]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:07 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:07 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:07 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:07 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:07 ntpd[22689]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:07.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:07 ntpd[22689]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:08.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:08 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:08.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:08 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:08.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:08 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:08.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:08 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:08.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:08 ntpd[22623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:08.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:08 ntpd[22623]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:08.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:08 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:08.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:08 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:08.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:08 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:08.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:08 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:08.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:08 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:08.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:08 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:08.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:08 ntpd[22689]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:08.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:08 ntpd[22689]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:09.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:09 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:09.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:09 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:09.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:09 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:09.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:09 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:09.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:09 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:09.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:09 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:09.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:09 ntpd[22623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:09.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:09 ntpd[22623]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:09.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:09 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:09.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:09 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:09.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:09 ntpd[22623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:09.904 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:09 ntpd[22623]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:09.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:09 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:09.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:09 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:09.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:09 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:09.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:09 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:09.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:09 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:09.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:09 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:09.909 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:09 ntpd[22689]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:09.909 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:09 ntpd[22689]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:09.909 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:09 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:09.909 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:09 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:09.909 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:09 ntpd[22689]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:09.909 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:09 ntpd[22689]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:10.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:10 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:10.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:10 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:10.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:10 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:10.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:10 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:10.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:10 ntpd[22623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:10.902 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:10 ntpd[22623]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:10.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:10 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:10.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:10 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:10.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:10 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:10.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:10 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:10.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:10 ntpd[22689]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:10.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:10 ntpd[22689]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:11 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:11 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:11 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:11 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:11 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:11 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:11.903 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:11 ntpd[22623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:11 ntpd[22623]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:11 ntpd[22623]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:11 ntpd[22623]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:11 ntpd[22623]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:11.904 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:11 ntpd[22623]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:11.904 INFO:teuthology.orchestra.run.smithi055.stdout:30 Sep 01:53:11 ntpd[22623]: ntpd: time slew +0.000560 s 2023-09-30T01:53:11.904 INFO:teuthology.orchestra.run.smithi055.stdout:ntpd: time slew +0.000560s 2023-09-30T01:53:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:11 ntpd[22623]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-09-30T01:53:11.905 INFO:teuthology.orchestra.run.smithi055.stderr:30 Sep 01:53:11 ntpd[22623]: can't open /var/log/ntpstats/loopstats.20230930: Permission denied 2023-09-30T01:53:11.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:11 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:11.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:11 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:11.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:11 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:11.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:11 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:11.908 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:11 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:11 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:11 ntpd[22689]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:11 ntpd[22689]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:11 ntpd[22689]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2023-09-30T01:53:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:11 ntpd[22689]: can't open /var/log/ntpstats/rawstats.20230930: Permission denied 2023-09-30T01:53:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:11 ntpd[22689]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2023-09-30T01:53:11.909 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:11 ntpd[22689]: can't open /var/log/ntpstats/peerstats.20230930: Permission denied 2023-09-30T01:53:11.910 INFO:teuthology.orchestra.run.smithi133.stdout:30 Sep 01:53:11 ntpd[22689]: ntpd: time slew +0.001493 s 2023-09-30T01:53:11.910 INFO:teuthology.orchestra.run.smithi133.stdout:ntpd: time slew +0.001493s 2023-09-30T01:53:11.910 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:11 ntpd[22689]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2023-09-30T01:53:11.910 INFO:teuthology.orchestra.run.smithi133.stderr:30 Sep 01:53:11 ntpd[22689]: can't open /var/log/ntpstats/loopstats.20230930: Permission denied 2023-09-30T01:53:11.967 INFO:teuthology.orchestra.run.smithi055.stdout: remote refid st t when poll reach delay offset jitter 2023-09-30T01:53:11.968 INFO:teuthology.orchestra.run.smithi055.stdout:============================================================================== 2023-09-30T01:53:11.968 INFO:teuthology.orchestra.run.smithi055.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-30T01:53:11.968 INFO:teuthology.orchestra.run.smithi055.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-30T01:53:11.968 INFO:teuthology.orchestra.run.smithi055.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-30T01:53:11.968 INFO:teuthology.orchestra.run.smithi055.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-30T01:53:11.976 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2023-09-30T01:53:11.976 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2023-09-30T01:53:11.976 INFO:teuthology.orchestra.run.smithi133.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-30T01:53:11.977 INFO:teuthology.orchestra.run.smithi133.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-30T01:53:11.977 INFO:teuthology.orchestra.run.smithi133.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-30T01:53:11.977 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-30T01:53:11.978 INFO:teuthology.run_tasks:Running task install... 2023-09-30T01:53:11.986 DEBUG:teuthology.task.install:project ceph 2023-09-30T01:53:11.987 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'}} 2023-09-30T01:53:11.987 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'} 2023-09-30T01:53:11.987 INFO:teuthology.task.install:Using flavor: default 2023-09-30T01:53:11.993 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-09-30T01:53:11.993 INFO:teuthology.task.install:extra packages: [] 2023-09-30T01:53:11.993 DEBUG:teuthology.orchestra.run.smithi055:> sudo apt-key list | grep Ceph 2023-09-30T01:53:11.994 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-key list | grep Ceph 2023-09-30T01:53:12.121 INFO:teuthology.orchestra.run.smithi133.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-09-30T01:53:12.123 INFO:teuthology.orchestra.run.smithi055.stderr:Warning: apt-key output should not be parsed (stdout is not a terminal) 2023-09-30T01:53:12.175 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-09-30T01:53:12.175 INFO:teuthology.orchestra.run.smithi133.stdout:uid [ unknown] Ceph.com (release key) 2023-09-30T01:53:12.176 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-09-30T01:53:12.177 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=93dce5e17918f8aca65993a7a2dc40233a47b481 2023-09-30T01:53:12.185 INFO:teuthology.orchestra.run.smithi055.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2023-09-30T01:53:12.186 INFO:teuthology.orchestra.run.smithi055.stdout:uid [ unknown] Ceph.com (release key) 2023-09-30T01:53:12.186 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2023-09-30T01:53:12.187 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=93dce5e17918f8aca65993a7a2dc40233a47b481 2023-09-30T01:53:12.337 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default/ 2023-09-30T01:53:12.337 INFO:teuthology.task.install.deb:Package version is 17.2.6-1165-g93dce5e1-1focal 2023-09-30T01:53:12.401 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default/ 2023-09-30T01:53:12.401 INFO:teuthology.task.install.deb:Package version is 17.2.6-1165-g93dce5e1-1focal 2023-09-30T01:53:12.448 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:53:12.448 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-09-30T01:53:12.464 DEBUG:teuthology.orchestra.run.smithi055:> sudo apt-get update 2023-09-30T01:53:12.512 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:53:12.512 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2023-09-30T01:53:12.529 DEBUG:teuthology.orchestra.run.smithi133:> sudo apt-get update 2023-09-30T01:53:12.628 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:1 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-09-30T01:53:12.717 INFO:teuthology.orchestra.run.smithi055.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal InRelease 2023-09-30T01:53:12.721 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:3 http://archive.ubuntu.com/ubuntu focal InRelease 2023-09-30T01:53:12.734 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:1 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal InRelease 2023-09-30T01:53:12.753 INFO:teuthology.orchestra.run.smithi055.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-09-30T01:53:12.755 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal Release [7,662 B] 2023-09-30T01:53:12.779 INFO:teuthology.orchestra.run.smithi133.stdout:Ign:3 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal Release.gpg 2023-09-30T01:53:12.792 INFO:teuthology.orchestra.run.smithi055.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal Release.gpg 2023-09-30T01:53:12.803 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:6 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-09-30T01:53:12.806 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:4 http://archive.ubuntu.com/ubuntu focal InRelease 2023-09-30T01:53:12.806 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:5 http://security.ubuntu.com/ubuntu focal-security InRelease 2023-09-30T01:53:12.806 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main i386 Packages [3,375 B] 2023-09-30T01:53:12.829 INFO:teuthology.orchestra.run.smithi055.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-09-30T01:53:12.840 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 Packages [17.4 kB] 2023-09-30T01:53:12.875 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:8 http://archive.ubuntu.com/ubuntu focal-updates InRelease 2023-09-30T01:53:12.882 INFO:teuthology.orchestra.run.smithi055.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main i386 Packages [3,375 B] 2023-09-30T01:53:12.884 INFO:teuthology.orchestra.run.smithi055.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-09-30T01:53:12.957 INFO:teuthology.orchestra.run.smithi133.stdout:Hit:9 http://archive.ubuntu.com/ubuntu focal-backports InRelease 2023-09-30T01:53:13.289 INFO:teuthology.orchestra.run.smithi055.stdout:Fetched 28.4 kB in 1s (42.5 kB/s) 2023-09-30T01:53:13.453 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 28.4 kB in 1s (37.8 kB/s) 2023-09-30T01:53:14.365 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2023-09-30T01:53:14.390 DEBUG:teuthology.orchestra.run.smithi055:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1165-g93dce5e1-1focal cephadm=17.2.6-1165-g93dce5e1-1focal ceph-mds=17.2.6-1165-g93dce5e1-1focal ceph-mgr=17.2.6-1165-g93dce5e1-1focal ceph-common=17.2.6-1165-g93dce5e1-1focal ceph-fuse=17.2.6-1165-g93dce5e1-1focal ceph-test=17.2.6-1165-g93dce5e1-1focal ceph-volume=17.2.6-1165-g93dce5e1-1focal radosgw=17.2.6-1165-g93dce5e1-1focal python3-rados=17.2.6-1165-g93dce5e1-1focal python3-rgw=17.2.6-1165-g93dce5e1-1focal python3-cephfs=17.2.6-1165-g93dce5e1-1focal python3-rbd=17.2.6-1165-g93dce5e1-1focal libcephfs2=17.2.6-1165-g93dce5e1-1focal libcephfs-dev=17.2.6-1165-g93dce5e1-1focal librados2=17.2.6-1165-g93dce5e1-1focal librbd1=17.2.6-1165-g93dce5e1-1focal rbd-fuse=17.2.6-1165-g93dce5e1-1focal 2023-09-30T01:53:14.461 INFO:teuthology.orchestra.run.smithi055.stdout:Reading package lists... 2023-09-30T01:53:14.481 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-09-30T01:53:14.507 DEBUG:teuthology.orchestra.run.smithi133:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=17.2.6-1165-g93dce5e1-1focal cephadm=17.2.6-1165-g93dce5e1-1focal ceph-mds=17.2.6-1165-g93dce5e1-1focal ceph-mgr=17.2.6-1165-g93dce5e1-1focal ceph-common=17.2.6-1165-g93dce5e1-1focal ceph-fuse=17.2.6-1165-g93dce5e1-1focal ceph-test=17.2.6-1165-g93dce5e1-1focal ceph-volume=17.2.6-1165-g93dce5e1-1focal radosgw=17.2.6-1165-g93dce5e1-1focal python3-rados=17.2.6-1165-g93dce5e1-1focal python3-rgw=17.2.6-1165-g93dce5e1-1focal python3-cephfs=17.2.6-1165-g93dce5e1-1focal python3-rbd=17.2.6-1165-g93dce5e1-1focal libcephfs2=17.2.6-1165-g93dce5e1-1focal libcephfs-dev=17.2.6-1165-g93dce5e1-1focal librados2=17.2.6-1165-g93dce5e1-1focal librbd1=17.2.6-1165-g93dce5e1-1focal rbd-fuse=17.2.6-1165-g93dce5e1-1focal 2023-09-30T01:53:14.577 INFO:teuthology.orchestra.run.smithi133.stdout:Reading package lists... 2023-09-30T01:53:14.645 INFO:teuthology.orchestra.run.smithi055.stdout:Building dependency tree... 2023-09-30T01:53:14.646 INFO:teuthology.orchestra.run.smithi055.stdout:Reading state information... 2023-09-30T01:53:14.755 INFO:teuthology.orchestra.run.smithi133.stdout:Building dependency tree... 2023-09-30T01:53:14.756 INFO:teuthology.orchestra.run.smithi133.stdout:Reading state information... 2023-09-30T01:53:14.826 INFO:teuthology.orchestra.run.smithi055.stdout:The following packages were automatically installed and are no longer required: 2023-09-30T01:53:14.827 INFO:teuthology.orchestra.run.smithi055.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-09-30T01:53:14.827 INFO:teuthology.orchestra.run.smithi055.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-30T01:53:14.827 INFO:teuthology.orchestra.run.smithi055.stdout:The following additional packages will be installed: 2023-09-30T01:53:14.827 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-09-30T01:53:14.829 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-09-30T01:53:14.829 INFO:teuthology.orchestra.run.smithi055.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-09-30T01:53:14.829 INFO:teuthology.orchestra.run.smithi055.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-09-30T01:53:14.829 INFO:teuthology.orchestra.run.smithi055.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-09-30T01:53:14.829 INFO:teuthology.orchestra.run.smithi055.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-09-30T01:53:14.829 INFO:teuthology.orchestra.run.smithi055.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-09-30T01:53:14.829 INFO:teuthology.orchestra.run.smithi055.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-09-30T01:53:14.829 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 2023-09-30T01:53:14.829 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-09-30T01:53:14.829 INFO:teuthology.orchestra.run.smithi055.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-09-30T01:53:14.829 INFO:teuthology.orchestra.run.smithi055.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-09-30T01:53:14.830 INFO:teuthology.orchestra.run.smithi055.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-09-30T01:53:14.830 INFO:teuthology.orchestra.run.smithi055.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-09-30T01:53:14.830 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-09-30T01:53:14.830 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2023-09-30T01:53:14.830 INFO:teuthology.orchestra.run.smithi055.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2023-09-30T01:53:14.830 INFO:teuthology.orchestra.run.smithi055.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-09-30T01:53:14.830 INFO:teuthology.orchestra.run.smithi055.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-09-30T01:53:14.830 INFO:teuthology.orchestra.run.smithi055.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2023-09-30T01:53:14.830 INFO:teuthology.orchestra.run.smithi055.stdout: python3-websocket python3-webtest python3-werkzeug qttranslations5-l10n 2023-09-30T01:53:14.830 INFO:teuthology.orchestra.run.smithi055.stdout: socat xmlstarlet 2023-09-30T01:53:14.831 INFO:teuthology.orchestra.run.smithi055.stdout:Suggested packages: 2023-09-30T01:53:14.831 INFO:teuthology.orchestra.run.smithi055.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-09-30T01:53:14.831 INFO:teuthology.orchestra.run.smithi055.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-09-30T01:53:14.831 INFO:teuthology.orchestra.run.smithi055.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-09-30T01:53:14.831 INFO:teuthology.orchestra.run.smithi055.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-09-30T01:53:14.831 INFO:teuthology.orchestra.run.smithi055.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-09-30T01:53:14.831 INFO:teuthology.orchestra.run.smithi055.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-09-30T01:53:14.832 INFO:teuthology.orchestra.run.smithi055.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-09-30T01:53:14.832 INFO:teuthology.orchestra.run.smithi055.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-09-30T01:53:14.832 INFO:teuthology.orchestra.run.smithi055.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-09-30T01:53:14.832 INFO:teuthology.orchestra.run.smithi055.stdout:Recommended packages: 2023-09-30T01:53:14.832 INFO:teuthology.orchestra.run.smithi055.stdout: btrfs-tools 2023-09-30T01:53:14.924 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages were automatically installed and are no longer required: 2023-09-30T01:53:14.925 INFO:teuthology.orchestra.run.smithi133.stdout: libboost-iostreams1.71.0 libboost-thread1.71.0 2023-09-30T01:53:14.925 INFO:teuthology.orchestra.run.smithi133.stdout:Use 'sudo apt autoremove' to remove them. 2023-09-30T01:53:14.925 INFO:teuthology.orchestra.run.smithi133.stdout:The following additional packages will be installed: 2023-09-30T01:53:14.925 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2023-09-30T01:53:14.926 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd fonts-mathjax jq 2023-09-30T01:53:14.926 INFO:teuthology.orchestra.run.smithi133.stdout: libdouble-conversion3 libjq1 libjs-mathjax libjs-sphinxdoc libjs-underscore 2023-09-30T01:53:14.926 INFO:teuthology.orchestra.run.smithi133.stdout: liblbfgsb0 liblttng-ust0 liblua5.3-0 liboath0 libonig5 libpcre2-16-0 2023-09-30T01:53:14.926 INFO:teuthology.orchestra.run.smithi133.stdout: libqt5core5a libqt5dbus5 libqt5network5 librabbitmq4 libradosstriper1 2023-09-30T01:53:14.926 INFO:teuthology.orchestra.run.smithi133.stdout: librdkafka1 librgw2 libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli 2023-09-30T01:53:14.926 INFO:teuthology.orchestra.run.smithi133.stdout: python-natsort-doc python-pastedeploy-tpl python3-atomicwrites python3-attr 2023-09-30T01:53:14.926 INFO:teuthology.orchestra.run.smithi133.stdout: python3-bcrypt python3-blinker python3-bs4 python3-cachetools 2023-09-30T01:53:14.926 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-argparse python3-ceph-common python3-cherrypy3 2023-09-30T01:53:14.927 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography python3-decorator python3-google-auth python3-html5lib 2023-09-30T01:53:14.927 INFO:teuthology.orchestra.run.smithi133.stdout: python3-jinja2 python3-joblib python3-jwt python3-kubernetes 2023-09-30T01:53:14.927 INFO:teuthology.orchestra.run.smithi133.stdout: python3-logutils python3-lxml python3-mako python3-markupsafe 2023-09-30T01:53:14.927 INFO:teuthology.orchestra.run.smithi133.stdout: python3-natsort python3-oauthlib python3-openssl python3-packaging 2023-09-30T01:53:14.927 INFO:teuthology.orchestra.run.smithi133.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2023-09-30T01:53:14.927 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pluggy python3-prettytable python3-psutil python3-py python3-pyasn1 2023-09-30T01:53:14.927 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyasn1-modules python3-pyinotify python3-pytest python3-repoze.lru 2023-09-30T01:53:14.927 INFO:teuthology.orchestra.run.smithi133.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-scipy 2023-09-30T01:53:14.927 INFO:teuthology.orchestra.run.smithi133.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2023-09-30T01:53:14.927 INFO:teuthology.orchestra.run.smithi133.stdout: python3-sklearn python3-sklearn-lib python3-soupsieve python3-tempita 2023-09-30T01:53:14.927 INFO:teuthology.orchestra.run.smithi133.stdout: python3-waitress python3-wcwidth python3-webencodings python3-webob 2023-09-30T01:53:14.927 INFO:teuthology.orchestra.run.smithi133.stdout: python3-websocket python3-webtest python3-werkzeug qttranslations5-l10n 2023-09-30T01:53:14.928 INFO:teuthology.orchestra.run.smithi133.stdout: socat xmlstarlet 2023-09-30T01:53:14.928 INFO:teuthology.orchestra.run.smithi133.stdout:Suggested packages: 2023-09-30T01:53:14.928 INFO:teuthology.orchestra.run.smithi133.stdout: python3-influxdb fonts-mathjax-extras fonts-stix libjs-mathjax-doc 2023-09-30T01:53:14.928 INFO:teuthology.orchestra.run.smithi133.stdout: python-attr-doc python-blinker-doc python-cryptography-doc 2023-09-30T01:53:14.928 INFO:teuthology.orchestra.run.smithi133.stdout: python3-cryptography-vectors python3-genshi python-jinja2-doc python3-crypto 2023-09-30T01:53:14.928 INFO:teuthology.orchestra.run.smithi133.stdout: python3-lxml-dbg python-lxml-doc python3-beaker python-mako-doc 2023-09-30T01:53:14.928 INFO:teuthology.orchestra.run.smithi133.stdout: python-openssl-doc python3-openssl-dbg httpd-wsgi libapache2-mod-python 2023-09-30T01:53:14.928 INFO:teuthology.orchestra.run.smithi133.stdout: libapache2-mod-scgi libjs-mochikit python-pecan-doc python-psutil-doc 2023-09-30T01:53:14.928 INFO:teuthology.orchestra.run.smithi133.stdout: subversion python-pyinotify-doc python-scipy-doc python3-dap 2023-09-30T01:53:14.929 INFO:teuthology.orchestra.run.smithi133.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2023-09-30T01:53:14.929 INFO:teuthology.orchestra.run.smithi133.stdout: python-webtest-doc python-werkzeug-doc python3-termcolor python3-watchdog 2023-09-30T01:53:14.929 INFO:teuthology.orchestra.run.smithi133.stdout:Recommended packages: 2023-09-30T01:53:14.929 INFO:teuthology.orchestra.run.smithi133.stdout: btrfs-tools 2023-09-30T01:53:14.947 INFO:teuthology.orchestra.run.smithi055.stdout:The following NEW packages will be installed: 2023-09-30T01:53:14.947 INFO:teuthology.orchestra.run.smithi055.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-09-30T01:53:14.947 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-09-30T01:53:14.947 INFO:teuthology.orchestra.run.smithi055.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-09-30T01:53:14.947 INFO:teuthology.orchestra.run.smithi055.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-09-30T01:53:14.947 INFO:teuthology.orchestra.run.smithi055.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-09-30T01:53:14.947 INFO:teuthology.orchestra.run.smithi055.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-09-30T01:53:14.947 INFO:teuthology.orchestra.run.smithi055.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-09-30T01:53:14.949 INFO:teuthology.orchestra.run.smithi055.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-natsort-doc 2023-09-30T01:53:14.949 INFO:teuthology.orchestra.run.smithi055.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2023-09-30T01:53:14.949 INFO:teuthology.orchestra.run.smithi055.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-09-30T01:53:14.949 INFO:teuthology.orchestra.run.smithi055.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2023-09-30T01:53:14.949 INFO:teuthology.orchestra.run.smithi055.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-09-30T01:53:14.950 INFO:teuthology.orchestra.run.smithi055.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-09-30T01:53:14.950 INFO:teuthology.orchestra.run.smithi055.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-09-30T01:53:14.950 INFO:teuthology.orchestra.run.smithi055.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2023-09-30T01:53:14.950 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2023-09-30T01:53:14.951 INFO:teuthology.orchestra.run.smithi055.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-09-30T01:53:14.951 INFO:teuthology.orchestra.run.smithi055.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2023-09-30T01:53:14.951 INFO:teuthology.orchestra.run.smithi055.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2023-09-30T01:53:14.951 INFO:teuthology.orchestra.run.smithi055.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-09-30T01:53:14.951 INFO:teuthology.orchestra.run.smithi055.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-09-30T01:53:14.951 INFO:teuthology.orchestra.run.smithi055.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-09-30T01:53:14.951 INFO:teuthology.orchestra.run.smithi055.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-09-30T01:53:14.952 INFO:teuthology.orchestra.run.smithi055.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-09-30T01:53:14.952 INFO:teuthology.orchestra.run.smithi055.stdout:The following packages will be upgraded: 2023-09-30T01:53:14.952 INFO:teuthology.orchestra.run.smithi055.stdout: librados2 librbd1 2023-09-30T01:53:15.044 INFO:teuthology.orchestra.run.smithi133.stdout:The following NEW packages will be installed: 2023-09-30T01:53:15.044 INFO:teuthology.orchestra.run.smithi133.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2023-09-30T01:53:15.044 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2023-09-30T01:53:15.044 INFO:teuthology.orchestra.run.smithi133.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2023-09-30T01:53:15.045 INFO:teuthology.orchestra.run.smithi133.stdout: fonts-mathjax jq libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 2023-09-30T01:53:15.045 INFO:teuthology.orchestra.run.smithi133.stdout: libjs-mathjax libjs-sphinxdoc libjs-underscore liblbfgsb0 liblttng-ust0 2023-09-30T01:53:15.045 INFO:teuthology.orchestra.run.smithi133.stdout: liblua5.3-0 liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2023-09-30T01:53:15.045 INFO:teuthology.orchestra.run.smithi133.stdout: libqt5network5 librabbitmq4 libradosstriper1 librdkafka1 librgw2 2023-09-30T01:53:15.046 INFO:teuthology.orchestra.run.smithi133.stdout: libsqlite3-mod-ceph libthrift-0.13.0 nvme-cli python-natsort-doc 2023-09-30T01:53:15.046 INFO:teuthology.orchestra.run.smithi133.stdout: python-pastedeploy-tpl python3-atomicwrites python3-attr python3-bcrypt 2023-09-30T01:53:15.046 INFO:teuthology.orchestra.run.smithi133.stdout: python3-blinker python3-bs4 python3-cachetools python3-ceph-argparse 2023-09-30T01:53:15.046 INFO:teuthology.orchestra.run.smithi133.stdout: python3-ceph-common python3-cephfs python3-cherrypy3 python3-cryptography 2023-09-30T01:53:15.046 INFO:teuthology.orchestra.run.smithi133.stdout: python3-decorator python3-google-auth python3-html5lib python3-jinja2 2023-09-30T01:53:15.046 INFO:teuthology.orchestra.run.smithi133.stdout: python3-joblib python3-jwt python3-kubernetes python3-logutils python3-lxml 2023-09-30T01:53:15.046 INFO:teuthology.orchestra.run.smithi133.stdout: python3-mako python3-markupsafe python3-natsort python3-oauthlib 2023-09-30T01:53:15.046 INFO:teuthology.orchestra.run.smithi133.stdout: python3-openssl python3-packaging python3-paste python3-pastedeploy 2023-09-30T01:53:15.046 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pastescript python3-pecan python3-pluggy python3-prettytable 2023-09-30T01:53:15.046 INFO:teuthology.orchestra.run.smithi133.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2023-09-30T01:53:15.047 INFO:teuthology.orchestra.run.smithi133.stdout: python3-pyinotify python3-pytest python3-rados python3-rbd 2023-09-30T01:53:15.047 INFO:teuthology.orchestra.run.smithi133.stdout: python3-repoze.lru python3-requests-oauthlib python3-rgw python3-routes 2023-09-30T01:53:15.047 INFO:teuthology.orchestra.run.smithi133.stdout: python3-rsa python3-scipy python3-simplegeneric python3-simplejson 2023-09-30T01:53:15.047 INFO:teuthology.orchestra.run.smithi133.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-soupsieve 2023-09-30T01:53:15.047 INFO:teuthology.orchestra.run.smithi133.stdout: python3-tempita python3-waitress python3-wcwidth python3-webencodings 2023-09-30T01:53:15.047 INFO:teuthology.orchestra.run.smithi133.stdout: python3-webob python3-websocket python3-webtest python3-werkzeug 2023-09-30T01:53:15.047 INFO:teuthology.orchestra.run.smithi133.stdout: qttranslations5-l10n radosgw rbd-fuse socat xmlstarlet 2023-09-30T01:53:15.048 INFO:teuthology.orchestra.run.smithi133.stdout:The following packages will be upgraded: 2023-09-30T01:53:15.048 INFO:teuthology.orchestra.run.smithi133.stdout: librados2 librbd1 2023-09-30T01:53:15.141 INFO:teuthology.orchestra.run.smithi055.stdout:2 upgraded, 108 newly installed, 0 to remove and 245 not upgraded. 2023-09-30T01:53:15.142 INFO:teuthology.orchestra.run.smithi055.stdout:Need to get 209 MB of archives. 2023-09-30T01:53:15.142 INFO:teuthology.orchestra.run.smithi055.stdout:After this operation, 980 MB of additional disk space will be used. 2023-09-30T01:53:15.142 INFO:teuthology.orchestra.run.smithi055.stdout:Get:1 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-09-30T01:53:15.174 INFO:teuthology.orchestra.run.smithi055.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1165-g93dce5e1-1focal [3,501 kB] 2023-09-30T01:53:15.197 INFO:teuthology.orchestra.run.smithi133.stdout:2 upgraded, 108 newly installed, 0 to remove and 245 not upgraded. 2023-09-30T01:53:15.198 INFO:teuthology.orchestra.run.smithi133.stdout:Need to get 209 MB of archives. 2023-09-30T01:53:15.198 INFO:teuthology.orchestra.run.smithi133.stdout:After this operation, 980 MB of additional disk space will be used. 2023-09-30T01:53:15.198 INFO:teuthology.orchestra.run.smithi133.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 librbd1 amd64 17.2.6-1165-g93dce5e1-1focal [3,501 kB] 2023-09-30T01:53:15.239 INFO:teuthology.orchestra.run.smithi133.stdout:Get:2 http://archive.ubuntu.com/ubuntu focal/main amd64 liblttng-ust0 amd64 2.11.0-1 [160 kB] 2023-09-30T01:53:15.439 INFO:teuthology.orchestra.run.smithi133.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1165-g93dce5e1-1focal [3,552 kB] 2023-09-30T01:53:15.538 INFO:teuthology.orchestra.run.smithi055.stdout:Get:3 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-09-30T01:53:15.546 INFO:teuthology.orchestra.run.smithi055.stdout:Get:4 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-09-30T01:53:15.591 INFO:teuthology.orchestra.run.smithi055.stdout:Get:5 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-09-30T01:53:15.592 INFO:teuthology.orchestra.run.smithi133.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1165-g93dce5e1-1focal [758 kB] 2023-09-30T01:53:15.604 INFO:teuthology.orchestra.run.smithi055.stdout:Get:6 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-09-30T01:53:15.622 INFO:teuthology.orchestra.run.smithi133.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1165-g93dce5e1-1focal [414 kB] 2023-09-30T01:53:15.637 INFO:teuthology.orchestra.run.smithi133.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1165-g93dce5e1-1focal [22.5 kB] 2023-09-30T01:53:15.638 INFO:teuthology.orchestra.run.smithi133.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1165-g93dce5e1-1focal [200 kB] 2023-09-30T01:53:15.638 INFO:teuthology.orchestra.run.smithi133.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-prettytable all 0.7.2-5 [20.1 kB] 2023-09-30T01:53:15.644 INFO:teuthology.orchestra.run.smithi133.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1165-g93dce5e1-1focal [47.1 kB] 2023-09-30T01:53:15.646 INFO:teuthology.orchestra.run.smithi133.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal/main amd64 liblua5.3-0 amd64 5.3.3-1.1ubuntu2 [116 kB] 2023-09-30T01:53:15.646 INFO:teuthology.orchestra.run.smithi133.stdout:Get:11 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1165-g93dce5e1-1focal [385 kB] 2023-09-30T01:53:15.660 INFO:teuthology.orchestra.run.smithi133.stdout:Get:12 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1165-g93dce5e1-1focal [5,569 kB] 2023-09-30T01:53:15.690 INFO:teuthology.orchestra.run.smithi133.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/main amd64 librabbitmq4 amd64 0.10.0-1 [35.8 kB] 2023-09-30T01:53:15.704 INFO:teuthology.orchestra.run.smithi133.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/universe amd64 librdkafka1 amd64 1.2.1-1ubuntu1 [410 kB] 2023-09-30T01:53:15.730 INFO:teuthology.orchestra.run.smithi055.stdout:Get:7 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-09-30T01:53:15.736 INFO:teuthology.orchestra.run.smithi055.stdout:Get:8 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-09-30T01:53:15.737 INFO:teuthology.orchestra.run.smithi055.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 librados2 amd64 17.2.6-1165-g93dce5e1-1focal [3,552 kB] 2023-09-30T01:53:15.765 INFO:teuthology.orchestra.run.smithi055.stdout:Get:10 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-09-30T01:53:15.830 INFO:teuthology.orchestra.run.smithi133.stdout:Get:15 http://archive.ubuntu.com/ubuntu focal/universe amd64 libdouble-conversion3 amd64 3.1.5-4ubuntu1 [37.9 kB] 2023-09-30T01:53:15.836 INFO:teuthology.orchestra.run.smithi133.stdout:Get:16 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libpcre2-16-0 amd64 10.34-7ubuntu0.1 [181 kB] 2023-09-30T01:53:15.865 INFO:teuthology.orchestra.run.smithi133.stdout:Get:17 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5core5a amd64 5.12.8+dfsg-0ubuntu2.1 [2,006 kB] 2023-09-30T01:53:15.908 INFO:teuthology.orchestra.run.smithi055.stdout:Get:11 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-09-30T01:53:15.908 INFO:teuthology.orchestra.run.smithi133.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1165-g93dce5e1-1focal [116 kB] 2023-09-30T01:53:15.910 INFO:teuthology.orchestra.run.smithi133.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1165-g93dce5e1-1focal [480 kB] 2023-09-30T01:53:15.915 INFO:teuthology.orchestra.run.smithi055.stdout:Get:12 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-09-30T01:53:15.926 INFO:teuthology.orchestra.run.smithi133.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1165-g93dce5e1-1focal [27.7 MB] 2023-09-30T01:53:15.938 INFO:teuthology.orchestra.run.smithi055.stdout:Get:13 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-09-30T01:53:16.008 INFO:teuthology.orchestra.run.smithi133.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5dbus5 amd64 5.12.8+dfsg-0ubuntu2.1 [208 kB] 2023-09-30T01:53:16.016 INFO:teuthology.orchestra.run.smithi133.stdout:Get:22 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libqt5network5 amd64 5.12.8+dfsg-0ubuntu2.1 [673 kB] 2023-09-30T01:53:16.039 INFO:teuthology.orchestra.run.smithi133.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/universe amd64 libthrift-0.13.0 amd64 0.13.0-2build2 [249 kB] 2023-09-30T01:53:16.109 INFO:teuthology.orchestra.run.smithi055.stdout:Get:14 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-09-30T01:53:16.128 INFO:teuthology.orchestra.run.smithi055.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libcephfs2 amd64 17.2.6-1165-g93dce5e1-1focal [758 kB] 2023-09-30T01:53:16.210 INFO:teuthology.orchestra.run.smithi133.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 liboath0 amd64 2.6.1-1.3 [44.7 kB] 2023-09-30T01:53:16.233 INFO:teuthology.orchestra.run.smithi055.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-rados amd64 17.2.6-1165-g93dce5e1-1focal [414 kB] 2023-09-30T01:53:16.277 INFO:teuthology.orchestra.run.smithi055.stdout:Get:17 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-argparse all 17.2.6-1165-g93dce5e1-1focal [22.5 kB] 2023-09-30T01:53:16.280 INFO:teuthology.orchestra.run.smithi055.stdout:Get:18 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-cephfs amd64 17.2.6-1165-g93dce5e1-1focal [200 kB] 2023-09-30T01:53:16.310 INFO:teuthology.orchestra.run.smithi055.stdout:Get:19 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-ceph-common all 17.2.6-1165-g93dce5e1-1focal [47.1 kB] 2023-09-30T01:53:16.314 INFO:teuthology.orchestra.run.smithi055.stdout:Get:20 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-rbd amd64 17.2.6-1165-g93dce5e1-1focal [385 kB] 2023-09-30T01:53:16.358 INFO:teuthology.orchestra.run.smithi055.stdout:Get:21 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-09-30T01:53:16.361 INFO:teuthology.orchestra.run.smithi055.stdout:Get:22 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 librgw2 amd64 17.2.6-1165-g93dce5e1-1focal [5,569 kB] 2023-09-30T01:53:16.458 INFO:teuthology.orchestra.run.smithi133.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-cryptography amd64 2.8-3ubuntu0.1 [211 kB] 2023-09-30T01:53:16.552 INFO:teuthology.orchestra.run.smithi055.stdout:Get:23 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-09-30T01:53:16.571 INFO:teuthology.orchestra.run.smithi055.stdout:Get:24 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-09-30T01:53:16.585 INFO:teuthology.orchestra.run.smithi055.stdout:Get:25 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-09-30T01:53:16.637 INFO:teuthology.orchestra.run.smithi055.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-09-30T01:53:16.645 INFO:teuthology.orchestra.run.smithi055.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-09-30T01:53:16.648 INFO:teuthology.orchestra.run.smithi055.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-09-30T01:53:16.652 INFO:teuthology.orchestra.run.smithi055.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-09-30T01:53:16.653 INFO:teuthology.orchestra.run.smithi133.stdout:Get:26 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-openssl all 19.0.0-1build1 [43.3 kB] 2023-09-30T01:53:16.655 INFO:teuthology.orchestra.run.smithi055.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-09-30T01:53:16.667 INFO:teuthology.orchestra.run.smithi055.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-09-30T01:53:16.672 INFO:teuthology.orchestra.run.smithi133.stdout:Get:27 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bcrypt amd64 3.1.7-2ubuntu1 [30.4 kB] 2023-09-30T01:53:16.686 INFO:teuthology.orchestra.run.smithi133.stdout:Get:28 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cherrypy3 all 8.9.1-6 [160 kB] 2023-09-30T01:53:16.738 INFO:teuthology.orchestra.run.smithi133.stdout:Get:29 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-natsort all 7.0.1-1 [29.2 kB] 2023-09-30T01:53:16.745 INFO:teuthology.orchestra.run.smithi133.stdout:Get:30 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-jwt all 1.7.1-2ubuntu2.1 [18.0 kB] 2023-09-30T01:53:16.749 INFO:teuthology.orchestra.run.smithi133.stdout:Get:31 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-logutils all 0.3.3-7 [17.3 kB] 2023-09-30T01:53:16.752 INFO:teuthology.orchestra.run.smithi133.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-markupsafe amd64 1.1.0-1build2 [13.9 kB] 2023-09-30T01:53:16.755 INFO:teuthology.orchestra.run.smithi133.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-mako all 1.1.0+ds1-1ubuntu2.1 [59.2 kB] 2023-09-30T01:53:16.767 INFO:teuthology.orchestra.run.smithi133.stdout:Get:34 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2023-09-30T01:53:16.833 INFO:teuthology.orchestra.run.smithi055.stdout:Get:32 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-09-30T01:53:16.916 INFO:teuthology.orchestra.run.smithi055.stdout:Get:33 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-09-30T01:53:16.933 INFO:teuthology.orchestra.run.smithi133.stdout:Get:35 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-singledispatch all 3.4.0.3-2build1 [7,128 B] 2023-09-30T01:53:17.017 INFO:teuthology.orchestra.run.smithi133.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webob all 1:1.8.5-2 [84.4 kB] 2023-09-30T01:53:17.051 INFO:teuthology.orchestra.run.smithi055.stdout:Get:34 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 python3-rgw amd64 17.2.6-1165-g93dce5e1-1focal [116 kB] 2023-09-30T01:53:17.064 INFO:teuthology.orchestra.run.smithi055.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libradosstriper1 amd64 17.2.6-1165-g93dce5e1-1focal [480 kB] 2023-09-30T01:53:17.101 INFO:teuthology.orchestra.run.smithi055.stdout:Get:36 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-09-30T01:53:17.123 INFO:teuthology.orchestra.run.smithi055.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-common amd64 17.2.6-1165-g93dce5e1-1focal [27.7 MB] 2023-09-30T01:53:17.135 INFO:teuthology.orchestra.run.smithi055.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-09-30T01:53:17.200 INFO:teuthology.orchestra.run.smithi055.stdout:Get:39 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-09-30T01:53:17.232 INFO:teuthology.orchestra.run.smithi133.stdout:Get:37 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-soupsieve all 1.9.5+dfsg-1 [29.1 kB] 2023-09-30T01:53:17.239 INFO:teuthology.orchestra.run.smithi055.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-09-30T01:53:17.246 INFO:teuthology.orchestra.run.smithi055.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-09-30T01:53:17.298 INFO:teuthology.orchestra.run.smithi133.stdout:Get:38 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-bs4 all 4.8.2-1 [83.0 kB] 2023-09-30T01:53:17.299 INFO:teuthology.orchestra.run.smithi133.stdout:Get:39 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1165-g93dce5e1-1focal [6,453 kB] 2023-09-30T01:53:17.301 INFO:teuthology.orchestra.run.smithi133.stdout:Get:40 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-waitress all 1.4.1-1ubuntu0.1 [81.4 kB] 2023-09-30T01:53:17.341 INFO:teuthology.orchestra.run.smithi133.stdout:Get:41 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-tempita all 0.5.2-6 [14.8 kB] 2023-09-30T01:53:17.347 INFO:teuthology.orchestra.run.smithi133.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-paste all 3.4.0+dfsg1-1 [456 kB] 2023-09-30T01:53:17.356 INFO:teuthology.orchestra.run.smithi055.stdout:Get:42 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-09-30T01:53:17.357 INFO:teuthology.orchestra.run.smithi055.stdout:Get:43 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-09-30T01:53:17.360 INFO:teuthology.orchestra.run.smithi055.stdout:Get:44 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-09-30T01:53:17.365 INFO:teuthology.orchestra.run.smithi055.stdout:Get:45 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-09-30T01:53:17.463 INFO:teuthology.orchestra.run.smithi133.stdout:Get:43 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1165-g93dce5e1-1focal [221 kB] 2023-09-30T01:53:17.473 INFO:teuthology.orchestra.run.smithi133.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1165-g93dce5e1-1focal [153 kB] 2023-09-30T01:53:17.481 INFO:teuthology.orchestra.run.smithi133.stdout:Get:45 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1165-g93dce5e1-1focal [1,589 kB] 2023-09-30T01:53:17.487 INFO:teuthology.orchestra.run.smithi133.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal/main amd64 python-pastedeploy-tpl all 2.1.0-1 [5,016 B] 2023-09-30T01:53:17.488 INFO:teuthology.orchestra.run.smithi133.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastedeploy all 2.1.0-1 [26.5 kB] 2023-09-30T01:53:17.492 INFO:teuthology.orchestra.run.smithi133.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webtest all 2.0.32-2 [28.2 kB] 2023-09-30T01:53:17.497 INFO:teuthology.orchestra.run.smithi133.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pecan all 1.3.3-3ubuntu1 [85.8 kB] 2023-09-30T01:53:17.541 INFO:teuthology.orchestra.run.smithi055.stdout:Get:46 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-09-30T01:53:17.551 INFO:teuthology.orchestra.run.smithi133.stdout:Get:50 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1165-g93dce5e1-1focal [7,845 kB] 2023-09-30T01:53:17.674 INFO:teuthology.orchestra.run.smithi133.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-werkzeug all 0.16.1+dfsg1-2ubuntu0.1 [183 kB] 2023-09-30T01:53:17.906 INFO:teuthology.orchestra.run.smithi133.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1165-g93dce5e1-1focal [28.7 MB] 2023-09-30T01:53:17.957 INFO:teuthology.orchestra.run.smithi055.stdout:Get:47 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-09-30T01:53:17.989 INFO:teuthology.orchestra.run.smithi055.stdout:Get:48 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-09-30T01:53:17.993 INFO:teuthology.orchestra.run.smithi055.stdout:Get:49 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-09-30T01:53:18.042 INFO:teuthology.orchestra.run.smithi055.stdout:Get:50 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-09-30T01:53:18.075 INFO:teuthology.orchestra.run.smithi055.stdout:Get:51 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-09-30T01:53:18.090 INFO:teuthology.orchestra.run.smithi133.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-jinja2 all 2.10.1-2 [95.5 kB] 2023-09-30T01:53:18.102 INFO:teuthology.orchestra.run.smithi055.stdout:Get:52 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-09-30T01:53:18.104 INFO:teuthology.orchestra.run.smithi055.stdout:Get:53 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-09-30T01:53:18.112 INFO:teuthology.orchestra.run.smithi055.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-09-30T01:53:18.121 INFO:teuthology.orchestra.run.smithi133.stdout:Get:54 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2023-09-30T01:53:18.126 INFO:teuthology.orchestra.run.smithi133.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 libjs-underscore all 1.9.1~dfsg-1ubuntu0.20.04.1 [99.5 kB] 2023-09-30T01:53:18.174 INFO:teuthology.orchestra.run.smithi133.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/main amd64 libjs-sphinxdoc all 1.8.5-7ubuntu3 [97.1 kB] 2023-09-30T01:53:18.207 INFO:teuthology.orchestra.run.smithi133.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-routes all 2.4.1-2 [88.1 kB] 2023-09-30T01:53:18.234 INFO:teuthology.orchestra.run.smithi133.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-decorator all 4.4.2-0ubuntu1 [10.3 kB] 2023-09-30T01:53:18.237 INFO:teuthology.orchestra.run.smithi133.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/universe amd64 liblbfgsb0 amd64 3.0+dfsg.3-7build1 [29.5 kB] 2023-09-30T01:53:18.245 INFO:teuthology.orchestra.run.smithi133.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-scipy amd64 1.3.3-3build1 [11.1 MB] 2023-09-30T01:53:18.548 INFO:teuthology.orchestra.run.smithi055.stdout:Get:55 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-09-30T01:53:18.629 INFO:teuthology.orchestra.run.smithi055.stdout:Get:56 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-09-30T01:53:18.682 INFO:teuthology.orchestra.run.smithi133.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn-lib amd64 0.22.2.post1+dfsg-5 [2,358 kB] 2023-09-30T01:53:18.761 INFO:teuthology.orchestra.run.smithi133.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-joblib all 0.14.0-3 [192 kB] 2023-09-30T01:53:18.794 INFO:teuthology.orchestra.run.smithi055.stdout:Get:57 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-09-30T01:53:18.926 INFO:teuthology.orchestra.run.smithi133.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-sklearn all 0.22.2.post1+dfsg-5 [1,773 kB] 2023-09-30T01:53:19.347 INFO:teuthology.orchestra.run.smithi133.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1165-g93dce5e1-1focal [3,928 B] 2023-09-30T01:53:19.348 INFO:teuthology.orchestra.run.smithi133.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1165-g93dce5e1-1focal [868 kB] 2023-09-30T01:53:19.362 INFO:teuthology.orchestra.run.smithi133.stdout:Get:66 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1165-g93dce5e1-1focal [2,404 kB] 2023-09-30T01:53:19.380 INFO:teuthology.orchestra.run.smithi133.stdout:Get:67 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1165-g93dce5e1-1focal [78.9 kB] 2023-09-30T01:53:19.381 INFO:teuthology.orchestra.run.smithi133.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1165-g93dce5e1-1focal [117 kB] 2023-09-30T01:53:19.382 INFO:teuthology.orchestra.run.smithi133.stdout:Get:69 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1165-g93dce5e1-1focal [1,760 kB] 2023-09-30T01:53:19.445 INFO:teuthology.orchestra.run.smithi133.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1165-g93dce5e1-1focal [7,861 kB] 2023-09-30T01:53:19.481 INFO:teuthology.orchestra.run.smithi055.stdout:Get:58 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-09-30T01:53:19.481 INFO:teuthology.orchestra.run.smithi055.stdout:Get:59 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-09-30T01:53:19.483 INFO:teuthology.orchestra.run.smithi055.stdout:Get:60 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-09-30T01:53:19.484 INFO:teuthology.orchestra.run.smithi055.stdout:Get:61 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-09-30T01:53:19.485 INFO:teuthology.orchestra.run.smithi055.stdout:Get:62 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-09-30T01:53:19.486 INFO:teuthology.orchestra.run.smithi055.stdout:Get:63 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-09-30T01:53:19.487 INFO:teuthology.orchestra.run.smithi055.stdout:Get:64 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-09-30T01:53:19.490 INFO:teuthology.orchestra.run.smithi055.stdout:Get:65 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-09-30T01:53:19.490 INFO:teuthology.orchestra.run.smithi055.stdout:Get:66 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-09-30T01:53:19.561 INFO:teuthology.orchestra.run.smithi055.stdout:Get:67 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-09-30T01:53:19.615 INFO:teuthology.orchestra.run.smithi133.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-cachetools all 4.0.0-1 [9,820 B] 2023-09-30T01:53:19.616 INFO:teuthology.orchestra.run.smithi133.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1 all 0.4.2-3build1 [46.7 kB] 2023-09-30T01:53:19.617 INFO:teuthology.orchestra.run.smithi133.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyasn1-modules all 0.2.1-0.2build1 [32.9 kB] 2023-09-30T01:53:19.619 INFO:teuthology.orchestra.run.smithi133.stdout:Get:74 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-rsa all 4.0-3 [24.7 kB] 2023-09-30T01:53:19.619 INFO:teuthology.orchestra.run.smithi133.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-google-auth all 1.5.1-2 [35.6 kB] 2023-09-30T01:53:19.621 INFO:teuthology.orchestra.run.smithi133.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-blinker all 1.4+dfsg1-0.3ubuntu1 [13.2 kB] 2023-09-30T01:53:19.622 INFO:teuthology.orchestra.run.smithi133.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-oauthlib all 3.1.0-1ubuntu2 [84.8 kB] 2023-09-30T01:53:19.623 INFO:teuthology.orchestra.run.smithi133.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-requests-oauthlib all 1.0.0-1.1build1 [16.8 kB] 2023-09-30T01:53:19.623 INFO:teuthology.orchestra.run.smithi133.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-websocket all 0.53.0-2ubuntu1 [32.3 kB] 2023-09-30T01:53:19.697 INFO:teuthology.orchestra.run.smithi133.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-kubernetes all 7.0.0~a1-2 [271 kB] 2023-09-30T01:53:19.734 INFO:teuthology.orchestra.run.smithi055.stdout:Get:68 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-09-30T01:53:19.803 INFO:teuthology.orchestra.run.smithi133.stdout:Get:81 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1165-g93dce5e1-1focal [4,048 B] 2023-09-30T01:53:19.804 INFO:teuthology.orchestra.run.smithi133.stdout:Get:82 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1165-g93dce5e1-1focal [56.2 MB] 2023-09-30T01:53:19.870 INFO:teuthology.orchestra.run.smithi133.stdout:Get:83 http://archive.ubuntu.com/ubuntu focal/universe amd64 libonig5 amd64 6.9.4-1 [142 kB] 2023-09-30T01:53:20.115 INFO:teuthology.orchestra.run.smithi055.stdout:Get:69 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-09-30T01:53:20.166 INFO:teuthology.orchestra.run.smithi055.stdout:Get:70 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-09-30T01:53:20.202 INFO:teuthology.orchestra.run.smithi055.stdout:Get:71 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-09-30T01:53:20.250 INFO:teuthology.orchestra.run.smithi133.stdout:Get:84 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 libjq1 amd64 1.6-1ubuntu0.20.04.1 [121 kB] 2023-09-30T01:53:20.302 INFO:teuthology.orchestra.run.smithi133.stdout:Get:85 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 jq amd64 1.6-1ubuntu0.20.04.1 [50.2 kB] 2023-09-30T01:53:20.302 INFO:teuthology.orchestra.run.smithi055.stdout:Get:72 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-09-30T01:53:20.338 INFO:teuthology.orchestra.run.smithi133.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 socat amd64 1.7.3.3-2 [323 kB] 2023-09-30T01:53:20.350 INFO:teuthology.orchestra.run.smithi055.stdout:Get:73 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-09-30T01:53:20.438 INFO:teuthology.orchestra.run.smithi133.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/universe amd64 xmlstarlet amd64 1.6.1-2build1 [267 kB] 2023-09-30T01:53:20.484 INFO:teuthology.orchestra.run.smithi055.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-base amd64 17.2.6-1165-g93dce5e1-1focal [6,453 kB] 2023-09-30T01:53:20.485 INFO:teuthology.orchestra.run.smithi133.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 fonts-mathjax all 2.7.4+dfsg-1 [2,208 kB] 2023-09-30T01:53:20.504 INFO:teuthology.orchestra.run.smithi055.stdout:Get:75 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-09-30T01:53:20.514 INFO:teuthology.orchestra.run.smithi055.stdout:Get:76 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-09-30T01:53:20.640 INFO:teuthology.orchestra.run.smithi133.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 nvme-cli amd64 1.9-1ubuntu0.1 [283 kB] 2023-09-30T01:53:20.650 INFO:teuthology.orchestra.run.smithi133.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal/universe amd64 libjs-mathjax all 2.7.4+dfsg-1 [5,654 kB] 2023-09-30T01:53:20.664 INFO:teuthology.orchestra.run.smithi055.stdout:Get:77 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-09-30T01:53:20.665 INFO:teuthology.orchestra.run.smithi055.stdout:Get:78 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-09-30T01:53:20.665 INFO:teuthology.orchestra.run.smithi055.stdout:Get:79 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-09-30T01:53:20.798 INFO:teuthology.orchestra.run.smithi133.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/universe amd64 python-natsort-doc all 7.0.1-1 [103 kB] 2023-09-30T01:53:20.800 INFO:teuthology.orchestra.run.smithi133.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-atomicwrites all 1.1.5-2build1 [7,016 B] 2023-09-30T01:53:20.800 INFO:teuthology.orchestra.run.smithi133.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-attr all 19.3.0-2 [33.9 kB] 2023-09-30T01:53:20.829 INFO:teuthology.orchestra.run.smithi055.stdout:Get:80 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-09-30T01:53:20.914 INFO:teuthology.orchestra.run.smithi055.stdout:Get:81 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-09-30T01:53:20.964 INFO:teuthology.orchestra.run.smithi133.stdout:Get:94 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-webencodings all 0.5.1-1ubuntu1 [11.0 kB] 2023-09-30T01:53:21.048 INFO:teuthology.orchestra.run.smithi133.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-html5lib all 1.0.1-2 [84.3 kB] 2023-09-30T01:53:21.094 INFO:teuthology.orchestra.run.smithi055.stdout:Get:82 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-09-30T01:53:21.225 INFO:teuthology.orchestra.run.smithi055.stdout:Get:83 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-modules-core all 17.2.6-1165-g93dce5e1-1focal [221 kB] 2023-09-30T01:53:21.229 INFO:teuthology.orchestra.run.smithi133.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal-updates/main amd64 python3-lxml amd64 4.5.0-1ubuntu0.5 [1,384 kB] 2023-09-30T01:53:21.255 INFO:teuthology.orchestra.run.smithi055.stdout:Get:84 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libsqlite3-mod-ceph amd64 17.2.6-1165-g93dce5e1-1focal [153 kB] 2023-09-30T01:53:21.269 INFO:teuthology.orchestra.run.smithi055.stdout:Get:85 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr amd64 17.2.6-1165-g93dce5e1-1focal [1,589 kB] 2023-09-30T01:53:21.423 INFO:teuthology.orchestra.run.smithi055.stdout:Get:86 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-09-30T01:53:21.424 INFO:teuthology.orchestra.run.smithi055.stdout:Get:87 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-09-30T01:53:21.429 INFO:teuthology.orchestra.run.smithi055.stdout:Get:88 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-09-30T01:53:21.430 INFO:teuthology.orchestra.run.smithi055.stdout:Get:89 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-09-30T01:53:21.440 INFO:teuthology.orchestra.run.smithi055.stdout:Get:90 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-09-30T01:53:21.445 INFO:teuthology.orchestra.run.smithi055.stdout:Get:91 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-09-30T01:53:21.446 INFO:teuthology.orchestra.run.smithi055.stdout:Get:92 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-09-30T01:53:21.447 INFO:teuthology.orchestra.run.smithi055.stdout:Get:93 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-09-30T01:53:21.466 INFO:teuthology.orchestra.run.smithi055.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mon amd64 17.2.6-1165-g93dce5e1-1focal [7,845 kB] 2023-09-30T01:53:21.560 INFO:teuthology.orchestra.run.smithi133.stdout:Get:97 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-packaging all 20.3-1 [26.8 kB] 2023-09-30T01:53:21.561 INFO:teuthology.orchestra.run.smithi133.stdout:Get:98 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2023-09-30T01:53:21.565 INFO:teuthology.orchestra.run.smithi133.stdout:Get:99 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pluggy all 0.13.0-2 [18.4 kB] 2023-09-30T01:53:21.566 INFO:teuthology.orchestra.run.smithi133.stdout:Get:100 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-psutil amd64 5.5.1-1ubuntu4 [141 kB] 2023-09-30T01:53:21.580 INFO:teuthology.orchestra.run.smithi133.stdout:Get:101 http://archive.ubuntu.com/ubuntu focal-updates/universe amd64 python3-py all 1.8.1-1ubuntu0.1 [65.6 kB] 2023-09-30T01:53:21.582 INFO:teuthology.orchestra.run.smithi133.stdout:Get:102 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-pyinotify all 0.9.6-1.2ubuntu1 [24.8 kB] 2023-09-30T01:53:21.583 INFO:teuthology.orchestra.run.smithi133.stdout:Get:103 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-wcwidth all 0.1.8+dfsg1-3 [17.4 kB] 2023-09-30T01:53:21.584 INFO:teuthology.orchestra.run.smithi133.stdout:Get:104 http://archive.ubuntu.com/ubuntu focal/universe amd64 python3-pytest all 4.6.9-1 [178 kB] 2023-09-30T01:53:21.622 INFO:teuthology.orchestra.run.smithi055.stdout:Get:95 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-09-30T01:53:21.758 INFO:teuthology.orchestra.run.smithi133.stdout:Get:105 http://archive.ubuntu.com/ubuntu focal/main amd64 python3-simplejson amd64 3.16.0-2ubuntu2 [50.8 kB] 2023-09-30T01:53:21.878 INFO:teuthology.orchestra.run.smithi055.stdout:Get:96 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-09-30T01:53:22.014 INFO:teuthology.orchestra.run.smithi133.stdout:Get:106 http://archive.ubuntu.com/ubuntu focal/universe amd64 qttranslations5-l10n all 5.12.8-0ubuntu1 [1,486 kB] 2023-09-30T01:53:22.400 INFO:teuthology.orchestra.run.smithi055.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-osd amd64 17.2.6-1165-g93dce5e1-1focal [28.7 MB] 2023-09-30T01:53:22.624 INFO:teuthology.orchestra.run.smithi133.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1165-g93dce5e1-1focal [229 kB] 2023-09-30T01:53:22.629 INFO:teuthology.orchestra.run.smithi133.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1165-g93dce5e1-1focal [21.9 kB] 2023-09-30T01:53:22.629 INFO:teuthology.orchestra.run.smithi133.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1165-g93dce5e1-1focal [17.0 MB] 2023-09-30T01:53:23.278 INFO:teuthology.orchestra.run.smithi133.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1165-g93dce5e1-1focal [79.5 kB] 2023-09-30T01:53:23.914 INFO:teuthology.orchestra.run.smithi133.stdout:Fetched 209 MB in 8s (25.5 MB/s) 2023-09-30T01:53:24.090 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-09-30T01:53:24.146 INFO:teuthology.orchestra.run.smithi133.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141758 files and directories currently installed.) 2023-09-30T01:53:24.150 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-09-30T01:53:24.239 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-09-30T01:53:24.446 INFO:teuthology.orchestra.run.smithi055.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph amd64 17.2.6-1165-g93dce5e1-1focal [3,928 B] 2023-09-30T01:53:24.447 INFO:teuthology.orchestra.run.smithi055.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-fuse amd64 17.2.6-1165-g93dce5e1-1focal [868 kB] 2023-09-30T01:53:24.460 INFO:teuthology.orchestra.run.smithi055.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mds amd64 17.2.6-1165-g93dce5e1-1focal [2,404 kB] 2023-09-30T01:53:24.566 INFO:teuthology.orchestra.run.smithi055.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 cephadm amd64 17.2.6-1165-g93dce5e1-1focal [78.9 kB] 2023-09-30T01:53:24.589 INFO:teuthology.orchestra.run.smithi055.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-cephadm all 17.2.6-1165-g93dce5e1-1focal [117 kB] 2023-09-30T01:53:24.592 INFO:teuthology.orchestra.run.smithi055.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-dashboard all 17.2.6-1165-g93dce5e1-1focal [1,760 kB] 2023-09-30T01:53:24.598 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../001-librbd1_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:24.674 INFO:teuthology.orchestra.run.smithi055.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-diskprediction-local all 17.2.6-1165-g93dce5e1-1focal [7,861 kB] 2023-09-30T01:53:24.722 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librbd1 (17.2.6-1165-g93dce5e1-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-09-30T01:53:25.102 INFO:teuthology.orchestra.run.smithi055.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-mgr-k8sevents all 17.2.6-1165-g93dce5e1-1focal [4,048 B] 2023-09-30T01:53:25.102 INFO:teuthology.orchestra.run.smithi055.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-test amd64 17.2.6-1165-g93dce5e1-1focal [56.2 MB] 2023-09-30T01:53:25.416 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../002-librados2_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:25.535 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librados2 (17.2.6-1165-g93dce5e1-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-09-30T01:53:26.257 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs2. 2023-09-30T01:53:26.272 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../003-libcephfs2_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:26.313 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:26.658 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rados. 2023-09-30T01:53:26.676 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../004-python3-rados_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:26.708 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rados (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:27.052 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-09-30T01:53:27.071 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../005-python3-ceph-argparse_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:53:27.110 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-argparse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:27.371 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cephfs. 2023-09-30T01:53:27.388 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../006-python3-cephfs_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:27.429 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cephfs (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:27.799 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-ceph-common. 2023-09-30T01:53:27.816 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../007-python3-ceph-common_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:53:27.848 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:28.177 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-prettytable. 2023-09-30T01:53:28.193 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../008-python3-prettytable_0.7.2-5_all.deb ... 2023-09-30T01:53:28.235 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-09-30T01:53:28.388 INFO:teuthology.orchestra.run.smithi055.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 ceph-volume all 17.2.6-1165-g93dce5e1-1focal [229 kB] 2023-09-30T01:53:28.392 INFO:teuthology.orchestra.run.smithi055.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 libcephfs-dev amd64 17.2.6-1165-g93dce5e1-1focal [21.9 kB] 2023-09-30T01:53:28.392 INFO:teuthology.orchestra.run.smithi055.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 radosgw amd64 17.2.6-1165-g93dce5e1-1focal [17.0 MB] 2023-09-30T01:53:28.496 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rbd. 2023-09-30T01:53:28.512 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../009-python3-rbd_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:28.554 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rbd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:28.907 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-09-30T01:53:28.927 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../010-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-09-30T01:53:28.965 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-09-30T01:53:29.235 INFO:teuthology.orchestra.run.smithi055.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-yuri4-testing-2023-09-29-0928-quincy/93dce5e17918f8aca65993a7a2dc40233a47b481/ubuntu/focal/flavors/default focal/main amd64 rbd-fuse amd64 17.2.6-1165-g93dce5e1-1focal [79.5 kB] 2023-09-30T01:53:29.351 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-09-30T01:53:29.368 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../011-librabbitmq4_0.10.0-1_amd64.deb ... 2023-09-30T01:53:29.409 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-09-30T01:53:29.754 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-09-30T01:53:29.773 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../012-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-09-30T01:53:29.812 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-09-30T01:53:29.894 INFO:teuthology.orchestra.run.smithi055.stdout:Fetched 209 MB in 14s (14.7 MB/s) 2023-09-30T01:53:30.062 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package liblttng-ust0:amd64. 2023-09-30T01:53:30.118 INFO:teuthology.orchestra.run.smithi055.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 141758 files and directories currently installed.) 2023-09-30T01:53:30.122 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../000-liblttng-ust0_2.11.0-1_amd64.deb ... 2023-09-30T01:53:30.186 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking liblttng-ust0:amd64 (2.11.0-1) ... 2023-09-30T01:53:30.190 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-09-30T01:53:30.210 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../013-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-09-30T01:53:30.248 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-09-30T01:53:30.506 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../001-librbd1_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:30.610 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-09-30T01:53:30.628 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../014-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-09-30T01:53:30.633 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librbd1 (17.2.6-1165-g93dce5e1-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-09-30T01:53:30.668 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-09-30T01:53:31.114 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-09-30T01:53:31.132 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../015-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-09-30T01:53:31.182 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-30T01:53:31.329 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../002-librados2_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:31.438 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librados2 (17.2.6-1165-g93dce5e1-1focal) over (15.2.17-0ubuntu0.20.04.4) ... 2023-09-30T01:53:31.960 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-09-30T01:53:31.976 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../016-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-09-30T01:53:32.018 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-30T01:53:32.150 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libcephfs2. 2023-09-30T01:53:32.168 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../003-libcephfs2_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:32.209 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libcephfs2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:32.352 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-09-30T01:53:32.371 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../017-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-09-30T01:53:32.410 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-30T01:53:32.536 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rados. 2023-09-30T01:53:32.555 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../004-python3-rados_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:32.594 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rados (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:32.805 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-09-30T01:53:32.821 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../018-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-09-30T01:53:32.854 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-09-30T01:53:32.983 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-ceph-argparse. 2023-09-30T01:53:33.000 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../005-python3-ceph-argparse_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:53:33.091 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-ceph-argparse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:33.158 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package librgw2. 2023-09-30T01:53:33.176 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../019-librgw2_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:33.208 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking librgw2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:33.519 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cephfs. 2023-09-30T01:53:33.536 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../006-python3-cephfs_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:33.577 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cephfs (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:33.938 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-ceph-common. 2023-09-30T01:53:33.957 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../007-python3-ceph-common_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:53:33.960 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rgw. 2023-09-30T01:53:33.979 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../020-python3-rgw_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:33.996 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:34.018 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:34.258 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-prettytable. 2023-09-30T01:53:34.277 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../008-python3-prettytable_0.7.2-5_all.deb ... 2023-09-30T01:53:34.307 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-prettytable (0.7.2-5) ... 2023-09-30T01:53:34.388 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liboath0. 2023-09-30T01:53:34.407 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-09-30T01:53:34.446 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-09-30T01:53:34.518 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rbd. 2023-09-30T01:53:34.534 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../009-python3-rbd_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:34.568 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rbd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:34.741 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libradosstriper1. 2023-09-30T01:53:34.757 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../022-libradosstriper1_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:34.790 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libradosstriper1 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:34.945 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package liblua5.3-0:amd64. 2023-09-30T01:53:34.963 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../010-liblua5.3-0_5.3.3-1.1ubuntu2_amd64.deb ... 2023-09-30T01:53:35.004 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-09-30T01:53:35.244 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-common. 2023-09-30T01:53:35.263 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../023-ceph-common_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:35.302 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:35.365 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librabbitmq4:amd64. 2023-09-30T01:53:35.391 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../011-librabbitmq4_0.10.0-1_amd64.deb ... 2023-09-30T01:53:35.424 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librabbitmq4:amd64 (0.10.0-1) ... 2023-09-30T01:53:35.710 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librdkafka1:amd64. 2023-09-30T01:53:35.727 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../012-librdkafka1_1.2.1-1ubuntu1_amd64.deb ... 2023-09-30T01:53:35.760 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-09-30T01:53:36.147 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2023-09-30T01:53:36.164 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../013-libdouble-conversion3_3.1.5-4ubuntu1_amd64.deb ... 2023-09-30T01:53:36.205 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-09-30T01:53:36.559 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2023-09-30T01:53:36.576 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../014-libpcre2-16-0_10.34-7ubuntu0.1_amd64.deb ... 2023-09-30T01:53:36.617 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-09-30T01:53:37.055 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqt5core5a:amd64. 2023-09-30T01:53:37.072 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../015-libqt5core5a_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-09-30T01:53:37.119 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-30T01:53:37.579 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2023-09-30T01:53:37.599 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../016-libqt5dbus5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-09-30T01:53:37.637 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-30T01:53:37.932 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-base. 2023-09-30T01:53:37.948 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../024-ceph-base_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:38.000 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-base (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:38.032 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libqt5network5:amd64. 2023-09-30T01:53:38.051 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../017-libqt5network5_5.12.8+dfsg-0ubuntu2.1_amd64.deb ... 2023-09-30T01:53:38.090 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-30T01:53:38.452 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libthrift-0.13.0. 2023-09-30T01:53:38.471 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../018-libthrift-0.13.0_0.13.0-2build2_amd64.deb ... 2023-09-30T01:53:38.510 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libthrift-0.13.0 (0.13.0-2build2) ... 2023-09-30T01:53:38.805 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package librgw2. 2023-09-30T01:53:38.823 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../019-librgw2_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:38.863 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking librgw2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:39.012 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cryptography. 2023-09-30T01:53:39.031 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../025-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-09-30T01:53:39.070 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-09-30T01:53:39.424 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-openssl. 2023-09-30T01:53:39.439 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../026-python3-openssl_19.0.0-1build1_all.deb ... 2023-09-30T01:53:39.473 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-09-30T01:53:39.632 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rgw. 2023-09-30T01:53:39.650 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../020-python3-rgw_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:39.690 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:39.768 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-09-30T01:53:39.784 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../027-ceph-mgr-modules-core_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:53:39.826 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:40.093 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package liboath0. 2023-09-30T01:53:40.113 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../021-liboath0_2.6.1-1.3_amd64.deb ... 2023-09-30T01:53:40.152 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking liboath0 (2.6.1-1.3) ... 2023-09-30T01:53:40.232 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-bcrypt. 2023-09-30T01:53:40.251 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../028-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-09-30T01:53:40.290 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-09-30T01:53:40.405 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libradosstriper1. 2023-09-30T01:53:40.423 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../022-libradosstriper1_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:40.454 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libradosstriper1 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:40.584 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cherrypy3. 2023-09-30T01:53:40.601 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../029-python3-cherrypy3_8.9.1-6_all.deb ... 2023-09-30T01:53:40.634 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-09-30T01:53:40.925 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-common. 2023-09-30T01:53:40.941 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../023-ceph-common_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:40.979 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-natsort. 2023-09-30T01:53:40.982 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:40.999 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../030-python3-natsort_7.0.1-1_all.deb ... 2023-09-30T01:53:41.037 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-09-30T01:53:41.374 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jwt. 2023-09-30T01:53:41.394 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../031-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-09-30T01:53:41.432 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-09-30T01:53:41.727 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-logutils. 2023-09-30T01:53:41.744 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../032-python3-logutils_0.3.3-7_all.deb ... 2023-09-30T01:53:41.785 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-09-30T01:53:42.122 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-markupsafe. 2023-09-30T01:53:42.137 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../033-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-09-30T01:53:42.180 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-09-30T01:53:42.499 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-mako. 2023-09-30T01:53:42.519 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../034-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-09-30T01:53:42.549 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-09-30T01:53:42.861 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplegeneric. 2023-09-30T01:53:42.877 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../035-python3-simplegeneric_0.8.1-3_all.deb ... 2023-09-30T01:53:42.944 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-09-30T01:53:43.247 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-singledispatch. 2023-09-30T01:53:43.265 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../036-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-09-30T01:53:43.305 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-09-30T01:53:43.633 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webob. 2023-09-30T01:53:43.649 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../037-python3-webob_1%3a1.8.5-2_all.deb ... 2023-09-30T01:53:43.691 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-09-30T01:53:43.780 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-base. 2023-09-30T01:53:43.796 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../024-ceph-base_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:43.848 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-base (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:44.036 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-soupsieve. 2023-09-30T01:53:44.055 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../038-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-09-30T01:53:44.094 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-09-30T01:53:44.389 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-bs4. 2023-09-30T01:53:44.405 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../039-python3-bs4_4.8.2-1_all.deb ... 2023-09-30T01:53:44.447 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-09-30T01:53:44.817 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-waitress. 2023-09-30T01:53:44.826 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cryptography. 2023-09-30T01:53:44.833 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../040-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-09-30T01:53:44.842 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../025-python3-cryptography_2.8-3ubuntu0.1_amd64.deb ... 2023-09-30T01:53:44.876 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cryptography (2.8-3ubuntu0.1) ... 2023-09-30T01:53:44.878 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-09-30T01:53:45.211 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-tempita. 2023-09-30T01:53:45.228 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-6_all.deb ... 2023-09-30T01:53:45.247 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-openssl. 2023-09-30T01:53:45.266 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../026-python3-openssl_19.0.0-1build1_all.deb ... 2023-09-30T01:53:45.269 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-09-30T01:53:45.297 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-openssl (19.0.0-1build1) ... 2023-09-30T01:53:45.572 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-paste. 2023-09-30T01:53:45.583 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2023-09-30T01:53:45.589 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../042-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-09-30T01:53:45.600 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../027-ceph-mgr-modules-core_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:53:45.641 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-modules-core (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:45.656 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-09-30T01:53:45.984 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-09-30T01:53:46.000 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-09-30T01:53:46.029 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-bcrypt. 2023-09-30T01:53:46.042 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-09-30T01:53:46.047 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../028-python3-bcrypt_3.1.7-2ubuntu1_amd64.deb ... 2023-09-30T01:53:46.087 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-bcrypt (3.1.7-2ubuntu1) ... 2023-09-30T01:53:46.373 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cherrypy3. 2023-09-30T01:53:46.386 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastedeploy. 2023-09-30T01:53:46.390 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../029-python3-cherrypy3_8.9.1-6_all.deb ... 2023-09-30T01:53:46.402 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../044-python3-pastedeploy_2.1.0-1_all.deb ... 2023-09-30T01:53:46.444 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-09-30T01:53:46.457 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cherrypy3 (8.9.1-6) ... 2023-09-30T01:53:46.773 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webtest. 2023-09-30T01:53:46.789 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../045-python3-webtest_2.0.32-2_all.deb ... 2023-09-30T01:53:46.793 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-natsort. 2023-09-30T01:53:46.810 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../030-python3-natsort_7.0.1-1_all.deb ... 2023-09-30T01:53:46.831 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-09-30T01:53:46.851 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-natsort (7.0.1-1) ... 2023-09-30T01:53:47.146 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jwt. 2023-09-30T01:53:47.166 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../031-python3-jwt_1.7.1-2ubuntu2.1_all.deb ... 2023-09-30T01:53:47.204 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jwt (1.7.1-2ubuntu2.1) ... 2023-09-30T01:53:47.541 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-logutils. 2023-09-30T01:53:47.560 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../032-python3-logutils_0.3.3-7_all.deb ... 2023-09-30T01:53:47.599 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-logutils (0.3.3-7) ... 2023-09-30T01:53:47.842 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pecan. 2023-09-30T01:53:47.863 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../046-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-09-30T01:53:47.892 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-09-30T01:53:47.902 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-markupsafe. 2023-09-30T01:53:47.918 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../033-python3-markupsafe_1.1.0-1build2_amd64.deb ... 2023-09-30T01:53:47.960 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-markupsafe (1.1.0-1build2) ... 2023-09-30T01:53:48.248 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-mako. 2023-09-30T01:53:48.266 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../034-python3-mako_1.1.0+ds1-1ubuntu2.1_all.deb ... 2023-09-30T01:53:48.272 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-werkzeug. 2023-09-30T01:53:48.289 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../047-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-09-30T01:53:48.305 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-09-30T01:53:48.330 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-09-30T01:53:48.717 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-09-30T01:53:48.733 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../048-libsqlite3-mod-ceph_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:48.775 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:48.859 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-simplegeneric. 2023-09-30T01:53:48.879 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../035-python3-simplegeneric_0.8.1-3_all.deb ... 2023-09-30T01:53:49.144 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr. 2023-09-30T01:53:49.161 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../049-ceph-mgr_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:49.202 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:49.383 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2023-09-30T01:53:49.669 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-singledispatch. 2023-09-30T01:53:49.688 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../036-python3-singledispatch_3.4.0.3-2build1_all.deb ... 2023-09-30T01:53:49.723 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mon. 2023-09-30T01:53:49.728 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-singledispatch (3.4.0.3-2build1) ... 2023-09-30T01:53:49.738 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../050-ceph-mon_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:49.781 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mon (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:50.030 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-webob. 2023-09-30T01:53:50.045 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../037-python3-webob_1%3a1.8.5-2_all.deb ... 2023-09-30T01:53:50.089 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-webob (1:1.8.5-2) ... 2023-09-30T01:53:50.417 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-soupsieve. 2023-09-30T01:53:50.433 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../038-python3-soupsieve_1.9.5+dfsg-1_all.deb ... 2023-09-30T01:53:50.496 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-soupsieve (1.9.5+dfsg-1) ... 2023-09-30T01:53:50.803 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-bs4. 2023-09-30T01:53:50.820 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../039-python3-bs4_4.8.2-1_all.deb ... 2023-09-30T01:53:50.861 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-bs4 (4.8.2-1) ... 2023-09-30T01:53:50.943 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-osd. 2023-09-30T01:53:50.958 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../051-ceph-osd_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:51.000 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-osd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:51.222 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-waitress. 2023-09-30T01:53:51.240 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../040-python3-waitress_1.4.1-1ubuntu0.1_all.deb ... 2023-09-30T01:53:51.285 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-waitress (1.4.1-1ubuntu0.1) ... 2023-09-30T01:53:51.642 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-tempita. 2023-09-30T01:53:51.660 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../041-python3-tempita_0.5.2-6_all.deb ... 2023-09-30T01:53:51.701 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-tempita (0.5.2-6) ... 2023-09-30T01:53:52.036 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-paste. 2023-09-30T01:53:52.053 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../042-python3-paste_3.4.0+dfsg1-1_all.deb ... 2023-09-30T01:53:52.094 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-paste (3.4.0+dfsg1-1) ... 2023-09-30T01:53:52.398 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2023-09-30T01:53:52.414 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../043-python-pastedeploy-tpl_2.1.0-1_all.deb ... 2023-09-30T01:53:52.456 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python-pastedeploy-tpl (2.1.0-1) ... 2023-09-30T01:53:52.792 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pastedeploy. 2023-09-30T01:53:52.809 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../044-python3-pastedeploy_2.1.0-1_all.deb ... 2023-09-30T01:53:52.850 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pastedeploy (2.1.0-1) ... 2023-09-30T01:53:53.153 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-webtest. 2023-09-30T01:53:53.172 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../045-python3-webtest_2.0.32-2_all.deb ... 2023-09-30T01:53:53.211 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-webtest (2.0.32-2) ... 2023-09-30T01:53:53.514 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pecan. 2023-09-30T01:53:53.534 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../046-python3-pecan_1.3.3-3ubuntu1_all.deb ... 2023-09-30T01:53:53.597 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pecan (1.3.3-3ubuntu1) ... 2023-09-30T01:53:53.829 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph. 2023-09-30T01:53:53.845 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../052-ceph_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:53.887 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:53.936 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-werkzeug. 2023-09-30T01:53:53.953 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../047-python3-werkzeug_0.16.1+dfsg1-2ubuntu0.1_all.deb ... 2023-09-30T01:53:53.994 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-09-30T01:53:54.231 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-fuse. 2023-09-30T01:53:54.251 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../053-ceph-fuse_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:54.289 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:54.330 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2023-09-30T01:53:54.351 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../048-libsqlite3-mod-ceph_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:54.388 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libsqlite3-mod-ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:54.709 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mds. 2023-09-30T01:53:54.725 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../054-ceph-mds_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:54.767 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mds (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:54.775 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr. 2023-09-30T01:53:54.792 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../049-ceph-mgr_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:54.833 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:55.279 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package cephadm. 2023-09-30T01:53:55.296 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../055-cephadm_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:55.320 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mon. 2023-09-30T01:53:55.328 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:55.337 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../050-ceph-mon_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:55.378 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mon (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:55.673 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-jinja2. 2023-09-30T01:53:55.692 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2_all.deb ... 2023-09-30T01:53:55.731 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-09-30T01:53:56.050 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-09-30T01:53:56.070 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:53:56.108 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:56.448 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-osd. 2023-09-30T01:53:56.464 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../051-ceph-osd_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:56.478 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-repoze.lru. 2023-09-30T01:53:56.494 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../058-python3-repoze.lru_0.7-2_all.deb ... 2023-09-30T01:53:56.497 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-osd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:56.536 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-09-30T01:53:56.806 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjs-underscore. 2023-09-30T01:53:56.824 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../059-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-09-30T01:53:56.864 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-09-30T01:53:57.133 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-09-30T01:53:57.149 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../060-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-09-30T01:53:57.191 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-09-30T01:53:57.535 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-routes. 2023-09-30T01:53:57.553 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../061-python3-routes_2.4.1-2_all.deb ... 2023-09-30T01:53:57.593 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-09-30T01:53:57.955 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-09-30T01:53:57.973 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../062-ceph-mgr-dashboard_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:53:58.063 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:58.575 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-decorator. 2023-09-30T01:53:58.592 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../063-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-09-30T01:53:58.633 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-09-30T01:53:58.952 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-09-30T01:53:58.971 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../064-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-09-30T01:53:59.010 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-09-30T01:53:59.259 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph. 2023-09-30T01:53:59.276 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../052-ceph_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:59.317 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:53:59.321 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-scipy. 2023-09-30T01:53:59.338 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../065-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-09-30T01:53:59.371 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-09-30T01:53:59.620 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-fuse. 2023-09-30T01:53:59.637 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../053-ceph-fuse_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:53:59.706 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:00.090 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mds. 2023-09-30T01:54:00.108 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../054-ceph-mds_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:54:00.139 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mds (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:00.613 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-09-30T01:54:00.630 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../066-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-09-30T01:54:00.671 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-09-30T01:54:00.676 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package cephadm. 2023-09-30T01:54:00.692 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../055-cephadm_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:54:00.759 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:01.078 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-jinja2. 2023-09-30T01:54:01.097 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../056-python3-jinja2_2.10.1-2_all.deb ... 2023-09-30T01:54:01.137 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-jinja2 (2.10.1-2) ... 2023-09-30T01:54:01.242 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-joblib. 2023-09-30T01:54:01.258 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../067-python3-joblib_0.14.0-3_all.deb ... 2023-09-30T01:54:01.301 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-09-30T01:54:01.465 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2023-09-30T01:54:01.481 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../057-ceph-mgr-cephadm_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:54:01.523 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:01.670 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-sklearn. 2023-09-30T01:54:01.686 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../068-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-09-30T01:54:01.728 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-09-30T01:54:01.909 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-repoze.lru. 2023-09-30T01:54:01.926 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../058-python3-repoze.lru_0.7-2_all.deb ... 2023-09-30T01:54:01.967 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2023-09-30T01:54:02.220 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libjs-underscore. 2023-09-30T01:54:02.237 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../059-libjs-underscore_1.9.1~dfsg-1ubuntu0.20.04.1_all.deb ... 2023-09-30T01:54:02.278 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-09-30T01:54:02.445 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-09-30T01:54:02.462 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../069-ceph-mgr-diskprediction-local_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:54:02.502 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:02.539 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libjs-sphinxdoc. 2023-09-30T01:54:02.558 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../060-libjs-sphinxdoc_1.8.5-7ubuntu3_all.deb ... 2023-09-30T01:54:02.589 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-09-30T01:54:02.867 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-routes. 2023-09-30T01:54:02.884 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../061-python3-routes_2.4.1-2_all.deb ... 2023-09-30T01:54:02.925 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-routes (2.4.1-2) ... 2023-09-30T01:54:03.253 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2023-09-30T01:54:03.270 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../062-ceph-mgr-dashboard_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:54:03.311 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-dashboard (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:03.823 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-decorator. 2023-09-30T01:54:03.840 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../063-python3-decorator_4.4.2-0ubuntu1_all.deb ... 2023-09-30T01:54:03.881 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-decorator (4.4.2-0ubuntu1) ... 2023-09-30T01:54:03.922 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-cachetools. 2023-09-30T01:54:03.943 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../070-python3-cachetools_4.0.0-1_all.deb ... 2023-09-30T01:54:03.972 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-09-30T01:54:04.234 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package liblbfgsb0:amd64. 2023-09-30T01:54:04.252 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../064-liblbfgsb0_3.0+dfsg.3-7build1_amd64.deb ... 2023-09-30T01:54:04.292 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-09-30T01:54:04.308 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1. 2023-09-30T01:54:04.326 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-09-30T01:54:04.386 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-09-30T01:54:04.612 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-scipy. 2023-09-30T01:54:04.628 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../065-python3-scipy_1.3.3-3build1_amd64.deb ... 2023-09-30T01:54:04.670 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-scipy (1.3.3-3build1) ... 2023-09-30T01:54:04.703 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-09-30T01:54:04.719 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-09-30T01:54:04.769 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-09-30T01:54:05.114 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-rsa. 2023-09-30T01:54:05.132 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../073-python3-rsa_4.0-3_all.deb ... 2023-09-30T01:54:05.172 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-rsa (4.0-3) ... 2023-09-30T01:54:05.450 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-google-auth. 2023-09-30T01:54:05.468 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../074-python3-google-auth_1.5.1-2_all.deb ... 2023-09-30T01:54:05.517 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-09-30T01:54:05.820 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-blinker. 2023-09-30T01:54:05.839 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../075-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-09-30T01:54:05.878 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-09-30T01:54:06.189 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-oauthlib. 2023-09-30T01:54:06.206 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../076-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-09-30T01:54:06.247 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-09-30T01:54:06.287 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-sklearn-lib. 2023-09-30T01:54:06.307 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../066-python3-sklearn-lib_0.22.2.post1+dfsg-5_amd64.deb ... 2023-09-30T01:54:06.345 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-09-30T01:54:06.592 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-09-30T01:54:06.609 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../077-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-09-30T01:54:06.650 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-09-30T01:54:06.865 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-joblib. 2023-09-30T01:54:06.884 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../067-python3-joblib_0.14.0-3_all.deb ... 2023-09-30T01:54:06.940 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-joblib (0.14.0-3) ... 2023-09-30T01:54:06.962 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-websocket. 2023-09-30T01:54:06.978 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../078-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-09-30T01:54:07.022 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-09-30T01:54:07.327 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-sklearn. 2023-09-30T01:54:07.344 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../068-python3-sklearn_0.22.2.post1+dfsg-5_all.deb ... 2023-09-30T01:54:07.383 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-kubernetes. 2023-09-30T01:54:07.385 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-09-30T01:54:07.400 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../079-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-09-30T01:54:07.441 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-09-30T01:54:07.971 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-09-30T01:54:07.989 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../080-ceph-mgr-k8sevents_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:54:08.029 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:08.110 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2023-09-30T01:54:08.131 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../069-ceph-mgr-diskprediction-local_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:54:08.168 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-diskprediction-local (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:08.467 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libonig5:amd64. 2023-09-30T01:54:08.485 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../081-libonig5_6.9.4-1_amd64.deb ... 2023-09-30T01:54:08.525 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-09-30T01:54:08.903 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjq1:amd64. 2023-09-30T01:54:08.921 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../082-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-09-30T01:54:08.961 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-09-30T01:54:09.231 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package jq. 2023-09-30T01:54:09.247 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../083-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-09-30T01:54:09.296 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-cachetools. 2023-09-30T01:54:09.314 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../070-python3-cachetools_4.0.0-1_all.deb ... 2023-09-30T01:54:09.315 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-09-30T01:54:09.354 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-cachetools (4.0.0-1) ... 2023-09-30T01:54:09.533 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package socat. 2023-09-30T01:54:09.551 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../084-socat_1.7.3.3-2_amd64.deb ... 2023-09-30T01:54:09.591 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking socat (1.7.3.3-2) ... 2023-09-30T01:54:09.656 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyasn1. 2023-09-30T01:54:09.673 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../071-python3-pyasn1_0.4.2-3build1_all.deb ... 2023-09-30T01:54:09.717 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyasn1 (0.4.2-3build1) ... 2023-09-30T01:54:09.937 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package xmlstarlet. 2023-09-30T01:54:09.956 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-09-30T01:54:09.995 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-09-30T01:54:10.060 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyasn1-modules. 2023-09-30T01:54:10.079 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../072-python3-pyasn1-modules_0.2.1-0.2build1_all.deb ... 2023-09-30T01:54:10.118 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-09-30T01:54:10.325 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-test. 2023-09-30T01:54:10.344 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../086-ceph-test_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:54:10.399 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-test (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:10.420 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-rsa. 2023-09-30T01:54:10.439 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../073-python3-rsa_4.0-3_all.deb ... 2023-09-30T01:54:10.479 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-rsa (4.0-3) ... 2023-09-30T01:54:10.790 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-google-auth. 2023-09-30T01:54:10.806 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../074-python3-google-auth_1.5.1-2_all.deb ... 2023-09-30T01:54:10.848 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-google-auth (1.5.1-2) ... 2023-09-30T01:54:11.177 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-blinker. 2023-09-30T01:54:11.193 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../075-python3-blinker_1.4+dfsg1-0.3ubuntu1_all.deb ... 2023-09-30T01:54:11.226 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-09-30T01:54:11.446 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-oauthlib. 2023-09-30T01:54:11.465 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../076-python3-oauthlib_3.1.0-1ubuntu2_all.deb ... 2023-09-30T01:54:11.495 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-oauthlib (3.1.0-1ubuntu2) ... 2023-09-30T01:54:11.832 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-requests-oauthlib. 2023-09-30T01:54:11.849 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../077-python3-requests-oauthlib_1.0.0-1.1build1_all.deb ... 2023-09-30T01:54:11.890 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-09-30T01:54:12.235 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-websocket. 2023-09-30T01:54:12.255 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../078-python3-websocket_0.53.0-2ubuntu1_all.deb ... 2023-09-30T01:54:12.293 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-websocket (0.53.0-2ubuntu1) ... 2023-09-30T01:54:12.604 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-kubernetes. 2023-09-30T01:54:12.621 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../079-python3-kubernetes_7.0.0~a1-2_all.deb ... 2023-09-30T01:54:12.662 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-kubernetes (7.0.0~a1-2) ... 2023-09-30T01:54:13.284 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2023-09-30T01:54:13.301 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../080-ceph-mgr-k8sevents_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:54:13.342 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-mgr-k8sevents (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:13.747 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libonig5:amd64. 2023-09-30T01:54:13.764 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../081-libonig5_6.9.4-1_amd64.deb ... 2023-09-30T01:54:13.805 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libonig5:amd64 (6.9.4-1) ... 2023-09-30T01:54:14.192 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libjq1:amd64. 2023-09-30T01:54:14.209 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../082-libjq1_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-09-30T01:54:14.250 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-09-30T01:54:14.536 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package jq. 2023-09-30T01:54:14.553 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../083-jq_1.6-1ubuntu0.20.04.1_amd64.deb ... 2023-09-30T01:54:14.594 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking jq (1.6-1ubuntu0.20.04.1) ... 2023-09-30T01:54:14.855 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package socat. 2023-09-30T01:54:14.873 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../084-socat_1.7.3.3-2_amd64.deb ... 2023-09-30T01:54:14.913 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking socat (1.7.3.3-2) ... 2023-09-30T01:54:15.259 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package xmlstarlet. 2023-09-30T01:54:15.277 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../085-xmlstarlet_1.6.1-2build1_amd64.deb ... 2023-09-30T01:54:15.316 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking xmlstarlet (1.6.1-2build1) ... 2023-09-30T01:54:15.653 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package ceph-volume. 2023-09-30T01:54:15.670 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../087-ceph-volume_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:54:15.671 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-test. 2023-09-30T01:54:15.689 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../086-ceph-test_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:54:15.711 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking ceph-volume (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:15.729 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-test (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:16.049 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package fonts-mathjax. 2023-09-30T01:54:16.066 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../088-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-09-30T01:54:16.107 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-09-30T01:54:16.586 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libcephfs-dev. 2023-09-30T01:54:16.602 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../089-libcephfs-dev_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:54:16.644 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libcephfs-dev (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:17.072 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package nvme-cli. 2023-09-30T01:54:17.089 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-09-30T01:54:17.148 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-09-30T01:54:17.482 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package libjs-mathjax. 2023-09-30T01:54:17.500 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../091-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-09-30T01:54:17.540 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-09-30T01:54:19.219 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python-natsort-doc. 2023-09-30T01:54:19.238 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../092-python-natsort-doc_7.0.1-1_all.deb ... 2023-09-30T01:54:19.276 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-09-30T01:54:19.630 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-atomicwrites. 2023-09-30T01:54:19.651 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../093-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-09-30T01:54:19.688 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-09-30T01:54:19.983 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-attr. 2023-09-30T01:54:20.003 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../094-python3-attr_19.3.0-2_all.deb ... 2023-09-30T01:54:20.049 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-09-30T01:54:20.344 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-webencodings. 2023-09-30T01:54:20.361 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../095-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-09-30T01:54:20.419 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-09-30T01:54:20.721 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-html5lib. 2023-09-30T01:54:20.740 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../096-python3-html5lib_1.0.1-2_all.deb ... 2023-09-30T01:54:20.779 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-09-30T01:54:20.800 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package ceph-volume. 2023-09-30T01:54:20.817 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../087-ceph-volume_17.2.6-1165-g93dce5e1-1focal_all.deb ... 2023-09-30T01:54:20.860 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking ceph-volume (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:21.116 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-09-30T01:54:21.136 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../097-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-09-30T01:54:21.174 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-09-30T01:54:21.182 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package fonts-mathjax. 2023-09-30T01:54:21.202 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../088-fonts-mathjax_2.7.4+dfsg-1_all.deb ... 2023-09-30T01:54:21.240 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking fonts-mathjax (2.7.4+dfsg-1) ... 2023-09-30T01:54:21.660 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-packaging. 2023-09-30T01:54:21.680 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../098-python3-packaging_20.3-1_all.deb ... 2023-09-30T01:54:21.718 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-packaging (20.3-1) ... 2023-09-30T01:54:21.760 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libcephfs-dev. 2023-09-30T01:54:21.777 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../089-libcephfs-dev_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:54:21.815 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libcephfs-dev (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:22.054 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pastescript. 2023-09-30T01:54:22.071 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../099-python3-pastescript_2.0.2-4_all.deb ... 2023-09-30T01:54:22.112 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-09-30T01:54:22.194 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package nvme-cli. 2023-09-30T01:54:22.212 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../090-nvme-cli_1.9-1ubuntu0.1_amd64.deb ... 2023-09-30T01:54:22.270 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking nvme-cli (1.9-1ubuntu0.1) ... 2023-09-30T01:54:22.432 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pluggy. 2023-09-30T01:54:22.450 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../100-python3-pluggy_0.13.0-2_all.deb ... 2023-09-30T01:54:22.490 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-09-30T01:54:22.582 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package libjs-mathjax. 2023-09-30T01:54:22.603 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../091-libjs-mathjax_2.7.4+dfsg-1_all.deb ... 2023-09-30T01:54:22.640 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking libjs-mathjax (2.7.4+dfsg-1) ... 2023-09-30T01:54:22.835 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-psutil. 2023-09-30T01:54:22.856 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../101-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-09-30T01:54:22.893 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-09-30T01:54:23.263 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-py. 2023-09-30T01:54:23.279 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../102-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-09-30T01:54:23.321 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-09-30T01:54:23.674 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pyinotify. 2023-09-30T01:54:23.693 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../103-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-09-30T01:54:23.732 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-09-30T01:54:24.051 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-wcwidth. 2023-09-30T01:54:24.069 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../104-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-09-30T01:54:24.109 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-09-30T01:54:24.247 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python-natsort-doc. 2023-09-30T01:54:24.266 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../092-python-natsort-doc_7.0.1-1_all.deb ... 2023-09-30T01:54:24.313 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python-natsort-doc (7.0.1-1) ... 2023-09-30T01:54:24.421 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-pytest. 2023-09-30T01:54:24.438 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../105-python3-pytest_4.6.9-1_all.deb ... 2023-09-30T01:54:24.478 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-09-30T01:54:24.641 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-atomicwrites. 2023-09-30T01:54:24.661 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../093-python3-atomicwrites_1.1.5-2build1_all.deb ... 2023-09-30T01:54:24.699 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-atomicwrites (1.1.5-2build1) ... 2023-09-30T01:54:24.840 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package python3-simplejson. 2023-09-30T01:54:24.857 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../106-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-09-30T01:54:24.890 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-09-30T01:54:25.027 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-attr. 2023-09-30T01:54:25.048 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../094-python3-attr_19.3.0-2_all.deb ... 2023-09-30T01:54:25.085 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-attr (19.3.0-2) ... 2023-09-30T01:54:25.160 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-09-30T01:54:25.177 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../107-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-09-30T01:54:25.217 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-09-30T01:54:25.421 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-webencodings. 2023-09-30T01:54:25.440 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../095-python3-webencodings_0.5.1-1ubuntu1_all.deb ... 2023-09-30T01:54:25.479 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-webencodings (0.5.1-1ubuntu1) ... 2023-09-30T01:54:25.791 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-html5lib. 2023-09-30T01:54:25.809 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../096-python3-html5lib_1.0.1-2_all.deb ... 2023-09-30T01:54:25.849 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-html5lib (1.0.1-2) ... 2023-09-30T01:54:25.989 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package radosgw. 2023-09-30T01:54:26.006 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../108-radosgw_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:54:26.047 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking radosgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:26.193 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-lxml:amd64. 2023-09-30T01:54:26.212 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../097-python3-lxml_4.5.0-1ubuntu0.5_amd64.deb ... 2023-09-30T01:54:26.251 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-09-30T01:54:26.721 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-packaging. 2023-09-30T01:54:26.739 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../098-python3-packaging_20.3-1_all.deb ... 2023-09-30T01:54:26.779 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-packaging (20.3-1) ... 2023-09-30T01:54:27.074 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pastescript. 2023-09-30T01:54:27.095 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../099-python3-pastescript_2.0.2-4_all.deb ... 2023-09-30T01:54:27.132 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2023-09-30T01:54:27.485 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pluggy. 2023-09-30T01:54:27.503 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../100-python3-pluggy_0.13.0-2_all.deb ... 2023-09-30T01:54:27.543 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pluggy (0.13.0-2) ... 2023-09-30T01:54:27.767 INFO:teuthology.orchestra.run.smithi133.stdout:Selecting previously unselected package rbd-fuse. 2023-09-30T01:54:27.784 INFO:teuthology.orchestra.run.smithi133.stdout:Preparing to unpack .../109-rbd-fuse_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:54:27.825 INFO:teuthology.orchestra.run.smithi133.stdout:Unpacking rbd-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:27.838 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-psutil. 2023-09-30T01:54:27.859 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../101-python3-psutil_5.5.1-1ubuntu4_amd64.deb ... 2023-09-30T01:54:27.913 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-psutil (5.5.1-1ubuntu4) ... 2023-09-30T01:54:28.140 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-attr (19.3.0-2) ... 2023-09-30T01:54:28.241 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-py. 2023-09-30T01:54:28.258 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../102-python3-py_1.8.1-1ubuntu0.1_all.deb ... 2023-09-30T01:54:28.299 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-py (1.8.1-1ubuntu0.1) ... 2023-09-30T01:54:28.430 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-09-30T01:54:28.556 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-09-30T01:54:28.644 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pyinotify. 2023-09-30T01:54:28.663 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../103-python3-pyinotify_0.9.6-1.2ubuntu1_all.deb ... 2023-09-30T01:54:28.702 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-09-30T01:54:28.707 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-09-30T01:54:28.901 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:29.004 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-wcwidth. 2023-09-30T01:54:29.022 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../104-python3-wcwidth_0.1.8+dfsg1-3_all.deb ... 2023-09-30T01:54:29.062 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-wcwidth (0.1.8+dfsg1-3) ... 2023-09-30T01:54:29.374 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-pytest. 2023-09-30T01:54:29.393 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../105-python3-pytest_4.6.9-1_all.deb ... 2023-09-30T01:54:29.432 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-pytest (4.6.9-1) ... 2023-09-30T01:54:29.579 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user cephadm....done 2023-09-30T01:54:29.785 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-09-30T01:54:29.810 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package python3-simplejson. 2023-09-30T01:54:29.829 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../106-python3-simplejson_3.16.0-2ubuntu2_amd64.deb ... 2023-09-30T01:54:29.868 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking python3-simplejson (3.16.0-2ubuntu2) ... 2023-09-30T01:54:29.911 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-09-30T01:54:30.147 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package qttranslations5-l10n. 2023-09-30T01:54:30.164 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../107-qttranslations5-l10n_5.12.8-0ubuntu1_all.deb ... 2023-09-30T01:54:30.205 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-09-30T01:54:30.280 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-09-30T01:54:30.572 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-09-30T01:54:30.698 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-09-30T01:54:30.857 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-09-30T01:54:30.910 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package radosgw. 2023-09-30T01:54:30.929 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../108-radosgw_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:54:30.967 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking radosgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:31.184 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-09-30T01:54:31.603 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-09-30T01:54:31.905 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-09-30T01:54:32.180 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-09-30T01:54:32.473 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-09-30T01:54:32.749 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-argparse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:32.762 INFO:teuthology.orchestra.run.smithi055.stdout:Selecting previously unselected package rbd-fuse. 2023-09-30T01:54:32.779 INFO:teuthology.orchestra.run.smithi055.stdout:Preparing to unpack .../109-rbd-fuse_17.2.6-1165-g93dce5e1-1focal_amd64.deb ... 2023-09-30T01:54:32.820 INFO:teuthology.orchestra.run.smithi055.stdout:Unpacking rbd-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:33.042 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-09-30T01:54:33.132 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-attr (19.3.0-2) ... 2023-09-30T01:54:33.168 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-09-30T01:54:33.417 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librabbitmq4:amd64 (0.10.0-1) ... 2023-09-30T01:54:33.452 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-09-30T01:54:33.518 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libdouble-conversion3:amd64 (3.1.5-4ubuntu1) ... 2023-09-30T01:54:33.669 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up nvme-cli (1.9-1ubuntu0.1) ... 2023-09-30T01:54:33.762 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-09-30T01:54:33.862 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:33.882 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-09-30T01:54:34.377 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-09-30T01:54:34.469 INFO:teuthology.orchestra.run.smithi055.stdout:Adding system user cephadm....done 2023-09-30T01:54:34.647 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up fonts-mathjax (2.7.4+dfsg-1) ... 2023-09-30T01:54:34.661 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-09-30T01:54:34.782 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-waitress (1.4.1-1ubuntu0.1) ... 2023-09-30T01:54:34.930 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-09-30T01:54:35.134 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-repoze.lru (0.7-2) ... 2023-09-30T01:54:35.281 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-09-30T01:54:35.418 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libjs-mathjax (2.7.4+dfsg-1) ... 2023-09-30T01:54:35.558 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-09-30T01:54:35.640 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up liboath0 (2.6.1-1.3) ... 2023-09-30T01:54:35.861 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-py (1.8.1-1ubuntu0.1) ... 2023-09-30T01:54:35.882 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-09-30T01:54:36.167 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-packaging (20.3-1) ... 2023-09-30T01:54:36.179 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-joblib (0.14.0-3) ... 2023-09-30T01:54:36.478 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-09-30T01:54:36.582 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jwt (1.7.1-2ubuntu2.1) ... 2023-09-30T01:54:36.596 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-09-30T01:54:36.722 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-09-30T01:54:36.909 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cachetools (4.0.0-1) ... 2023-09-30T01:54:37.031 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-09-30T01:54:37.186 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-bcrypt (3.1.7-2ubuntu1) ... 2023-09-30T01:54:37.428 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyinotify (0.9.6-1.2ubuntu1) ... 2023-09-30T01:54:37.441 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-09-30T01:54:37.737 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-ceph-argparse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:37.801 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-09-30T01:54:38.030 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-sklearn-lib (0.22.2.post1+dfsg-5) ... 2023-09-30T01:54:38.151 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-markupsafe (1.1.0-1build2) ... 2023-09-30T01:54:38.194 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up socat (1.7.3.3-2) ... 2023-09-30T01:54:38.312 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:38.411 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-webencodings (0.5.1-1ubuntu1) ... 2023-09-30T01:54:38.630 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-30T01:54:38.718 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libpcre2-16-0:amd64 (10.34-7ubuntu0.1) ... 2023-09-30T01:54:38.764 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-09-30T01:54:38.846 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-psutil (5.5.1-1ubuntu4) ... 2023-09-30T01:54:39.107 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-09-30T01:54:39.223 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-natsort (7.0.1-1) ... 2023-09-30T01:54:39.416 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-09-30T01:54:39.533 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-atomicwrites (1.1.5-2build1) ... 2023-09-30T01:54:39.567 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-09-30T01:54:39.811 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-simplejson (3.16.0-2ubuntu2) ... 2023-09-30T01:54:39.853 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-09-30T01:54:40.143 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-decorator (4.4.2-0ubuntu1) ... 2023-09-30T01:54:40.153 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-30T01:54:40.262 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-09-30T01:54:40.388 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-09-30T01:54:40.405 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-jinja2 (2.10.1-2) ... 2023-09-30T01:54:40.715 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-09-30T01:54:40.781 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-tempita (0.5.2-6) ... 2023-09-30T01:54:41.016 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-09-30T01:54:41.282 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-packaging (20.3-1) ... 2023-09-30T01:54:41.300 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-09-30T01:54:41.426 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-09-30T01:54:41.583 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python-pastedeploy-tpl (2.1.0-1) ... 2023-09-30T01:54:41.718 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up qttranslations5-l10n (5.12.8-0ubuntu1) ... 2023-09-30T01:54:41.728 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-09-30T01:54:41.844 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-wcwidth (0.1.8+dfsg1-3) ... 2023-09-30T01:54:42.012 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-09-30T01:54:42.112 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-paste (3.4.0+dfsg1-1) ... 2023-09-30T01:54:42.296 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-09-30T01:54:42.505 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-werkzeug (0.16.1+dfsg1-2ubuntu0.1) ... 2023-09-30T01:54:42.718 INFO:teuthology.orchestra.run.smithi133.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-09-30T01:54:42.881 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cryptography (2.8-3ubuntu0.1) ... 2023-09-30T01:54:43.001 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-09-30T01:54:43.111 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-09-30T01:54:43.250 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up socat (1.7.3.3-2) ... 2023-09-30T01:54:43.367 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:43.437 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-09-30T01:54:43.660 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqt5core5a:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-30T01:54:43.770 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-html5lib (1.0.1-2) ... 2023-09-30T01:54:43.780 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-09-30T01:54:43.931 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-09-30T01:54:44.058 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-09-30T01:54:44.138 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librdkafka1:amd64 (1.2.1-1ubuntu1) ... 2023-09-30T01:54:44.264 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up xmlstarlet (1.6.1-2build1) ... 2023-09-30T01:54:44.369 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-09-30T01:54:44.390 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pluggy (0.13.0-2) ... 2023-09-30T01:54:44.662 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librados2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:44.691 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-lxml:amd64 (4.5.0-1ubuntu0.5) ... 2023-09-30T01:54:44.763 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-09-30T01:54:45.018 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqt5dbus5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-30T01:54:45.119 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up liblua5.3-0:amd64 (5.3.3-1.1ubuntu2) ... 2023-09-30T01:54:45.220 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyasn1 (0.4.2-3build1) ... 2023-09-30T01:54:45.530 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-singledispatch (3.4.0.3-2build1) ... 2023-09-30T01:54:45.814 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-logutils (0.3.3-7) ... 2023-09-30T01:54:46.149 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up liblttng-ust0:amd64 (2.11.0-1) ... 2023-09-30T01:54:46.221 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:46.260 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2023-09-30T01:54:46.322 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-09-30T01:54:46.423 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-09-30T01:54:46.521 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-prettytable (0.7.2-5) ... 2023-09-30T01:54:46.808 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-09-30T01:54:46.822 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-soupsieve (1.9.5+dfsg-1) ... 2023-09-30T01:54:47.134 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-09-30T01:54:47.156 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-websocket (0.53.0-2ubuntu1) ... 2023-09-30T01:54:47.427 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-30T01:54:47.541 INFO:teuthology.orchestra.run.smithi055.stdout:update-alternatives: using /usr/bin/python3-wsdump to provide /usr/bin/wsdump (wsdump) in auto mode 2023-09-30T01:54:47.552 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-09-30T01:54:47.778 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libonig5:amd64 (6.9.4-1) ... 2023-09-30T01:54:47.904 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-mako (1.1.0+ds1-1ubuntu2.1) ... 2023-09-30T01:54:47.912 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:48.038 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-09-30T01:54:48.258 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cherrypy3 (8.9.1-6) ... 2023-09-30T01:54:48.365 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libradosstriper1 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:48.491 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-09-30T01:54:48.627 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libjs-underscore (1.9.1~dfsg-1ubuntu0.20.04.1) ... 2023-09-30T01:54:48.753 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up liblbfgsb0:amd64 (3.0+dfsg.3-7build1) ... 2023-09-30T01:54:48.825 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-09-30T01:54:48.879 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-webob (1:1.8.5-2) ... 2023-09-30T01:54:49.247 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-blinker (1.4+dfsg1-0.3ubuntu1) ... 2023-09-30T01:54:49.540 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librados2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:49.666 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-scipy (1.3.3-3build1) ... 2023-09-30T01:54:49.880 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librbd1 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:49.990 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-09-30T01:54:50.115 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-09-30T01:54:50.241 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-09-30T01:54:50.401 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rsa (4.0-3) ... 2023-09-30T01:54:50.702 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-09-30T01:54:50.828 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-09-30T01:54:51.146 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-modules-core (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:51.183 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libsqlite3-mod-ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:51.272 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:51.318 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libjq1:amd64 (1.6-1ubuntu0.20.04.1) ... 2023-09-30T01:54:51.444 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pytest (4.6.9-1) ... 2023-09-30T01:54:51.499 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-30T01:54:51.499 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-30T01:54:51.812 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-openssl (19.0.0-1build1) ... 2023-09-30T01:54:51.940 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up libcephfs-dev (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:52.122 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pastedeploy (2.1.0-1) ... 2023-09-30T01:54:52.167 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-09-30T01:54:52.415 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libqt5network5:amd64 (5.12.8+dfsg-0ubuntu2.1) ... 2023-09-30T01:54:52.461 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-09-30T01:54:52.541 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-bs4 (4.8.2-1) ... 2023-09-30T01:54:52.779 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-09-30T01:54:52.868 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libcephfs2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:52.994 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-oauthlib (3.1.0-1ubuntu2) ... 2023-09-30T01:54:53.140 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rados (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:53.265 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up librgw2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:53.338 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libradosstriper1 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:53.391 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rbd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:53.439 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pyasn1-modules (0.2.1-0.2build1) ... 2023-09-30T01:54:53.517 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up rbd-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:53.669 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-routes (2.4.1-2) ... 2023-09-30T01:54:53.773 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-sklearn (0.22.2.post1+dfsg-5) ... 2023-09-30T01:54:53.953 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-09-30T01:54:54.263 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-rgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:54.389 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-cephfs (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:54.515 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-09-30T01:54:54.838 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librbd1 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:54.947 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libjs-sphinxdoc (1.8.5-7ubuntu3) ... 2023-09-30T01:54:55.074 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python-natsort-doc (7.0.1-1) ... 2023-09-30T01:54:55.216 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up jq (1.6-1ubuntu0.20.04.1) ... 2023-09-30T01:54:55.343 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rsa (4.0-3) ... 2023-09-30T01:54:55.409 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:55.644 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libthrift-0.13.0 (0.13.0-2build2) ... 2023-09-30T01:54:55.745 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-webtest (2.0.32-2) ... 2023-09-30T01:54:55.954 INFO:teuthology.orchestra.run.smithi133.stdout:Adding group ceph....done 2023-09-30T01:54:56.155 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-modules-core (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:56.264 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:56.330 INFO:teuthology.orchestra.run.smithi133.stdout:Adding system user ceph....done 2023-09-30T01:54:56.494 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-30T01:54:56.494 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2023-09-30T01:54:56.506 INFO:teuthology.orchestra.run.smithi133.stdout:Setting system user ceph properties....done 2023-09-30T01:54:56.531 INFO:teuthology.orchestra.run.smithi133.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-09-30T01:54:56.675 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-09-30T01:54:56.966 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up libcephfs-dev (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:57.015 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-09-30T01:54:57.211 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-requests-oauthlib (1.0.0-1.1build1) ... 2023-09-30T01:54:57.477 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-test (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:57.479 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pastescript (2.0.2-4) ... 2023-09-30T01:54:57.603 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up radosgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:57.773 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-pecan (1.3.3-3ubuntu1) ... 2023-09-30T01:54:57.874 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-30T01:54:57.874 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-30T01:54:58.134 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rados (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:58.277 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up librgw2 (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:58.403 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rbd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:58.504 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up rbd-fuse (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:58.563 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-base (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:58.630 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-routes (2.4.1-2) ... 2023-09-30T01:54:58.915 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-google-auth (1.5.1-2) ... 2023-09-30T01:54:58.945 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-09-30T01:54:59.241 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-rgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:59.368 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-cephfs (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:59.407 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mds (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:54:59.494 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up python3-kubernetes (7.0.0~a1-2) ... 2023-09-30T01:54:59.639 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-30T01:54:59.639 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-30T01:55:00.092 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:00.347 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-30T01:55:00.347 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-30T01:55:00.448 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-common (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:00.785 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-osd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:00.992 INFO:teuthology.orchestra.run.smithi055.stdout:Adding group ceph....done 2023-09-30T01:55:01.297 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-30T01:55:01.297 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-30T01:55:01.361 INFO:teuthology.orchestra.run.smithi055.stdout:Adding system user ceph....done 2023-09-30T01:55:01.546 INFO:teuthology.orchestra.run.smithi055.stdout:Setting system user ceph properties....done 2023-09-30T01:55:01.570 INFO:teuthology.orchestra.run.smithi055.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2023-09-30T01:55:01.723 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2023-09-30T01:55:01.761 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:01.904 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:02.022 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mon (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:02.055 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2023-09-30T01:55:02.230 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-30T01:55:02.230 INFO:teuthology.orchestra.run.smithi133.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-30T01:55:02.542 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-test (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:02.660 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up radosgw (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:02.681 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:02.825 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:02.939 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-30T01:55:02.939 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2023-09-30T01:55:02.978 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-mgr-dashboard (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:03.121 INFO:teuthology.orchestra.run.smithi133.stdout:Setting up ceph-volume (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:03.223 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-09-30T01:55:03.366 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-09-30T01:55:03.596 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-base (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:03.692 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-09-30T01:55:03.983 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2023-09-30T01:55:04.448 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mds (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:04.670 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-30T01:55:04.670 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2023-09-30T01:55:05.133 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:05.350 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-30T01:55:05.351 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2023-09-30T01:55:05.801 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-osd (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:06.311 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-30T01:55:06.311 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2023-09-30T01:55:06.629 INFO:teuthology.orchestra.run.smithi133.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-09-30T01:55:06.780 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-k8sevents (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:06.908 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-diskprediction-local (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:07.052 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mon (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:07.235 INFO:teuthology.orchestra.run.smithi133.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-30T01:55:07.238 DEBUG:teuthology.parallel:result is None 2023-09-30T01:55:07.282 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-30T01:55:07.282 INFO:teuthology.orchestra.run.smithi055.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2023-09-30T01:55:07.753 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-cephadm (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:07.871 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:07.972 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-mgr-dashboard (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:08.098 INFO:teuthology.orchestra.run.smithi055.stdout:Setting up ceph-volume (17.2.6-1165-g93dce5e1-1focal) ... 2023-09-30T01:55:08.225 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for libc-bin (2.31-0ubuntu9.9) ... 2023-09-30T01:55:08.386 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for systemd (245.4-4ubuntu3.17) ... 2023-09-30T01:55:08.704 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for man-db (2.9.1-1) ... 2023-09-30T01:55:11.556 INFO:teuthology.orchestra.run.smithi055.stdout:Processing triggers for fontconfig (2.13.1-2ubuntu3) ... 2023-09-30T01:55:12.464 INFO:teuthology.orchestra.run.smithi055.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2023-09-30T01:55:12.467 DEBUG:teuthology.parallel:result is None 2023-09-30T01:55:12.467 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=93dce5e17918f8aca65993a7a2dc40233a47b481 2023-09-30T01:55:12.719 DEBUG:teuthology.orchestra.run.smithi055:> dpkg-query -W -f '${Version}' ceph 2023-09-30T01:55:12.742 INFO:teuthology.orchestra.run.smithi055.stdout:17.2.6-1165-g93dce5e1-1focal 2023-09-30T01:55:12.743 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1165-g93dce5e1-1focal 2023-09-30T01:55:12.743 INFO:teuthology.task.install:The correct ceph version 17.2.6-1165-g93dce5e1-1focal is installed. 2023-09-30T01:55:12.743 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F20.04%2Fx86_64&sha1=93dce5e17918f8aca65993a7a2dc40233a47b481 2023-09-30T01:55:12.977 DEBUG:teuthology.orchestra.run.smithi133:> dpkg-query -W -f '${Version}' ceph 2023-09-30T01:55:13.002 INFO:teuthology.orchestra.run.smithi133.stdout:17.2.6-1165-g93dce5e1-1focal 2023-09-30T01:55:13.002 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1165-g93dce5e1-1focal 2023-09-30T01:55:13.003 INFO:teuthology.task.install:The correct ceph version 17.2.6-1165-g93dce5e1-1focal is installed. 2023-09-30T01:55:13.003 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-09-30T01:55:13.003 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:13.003 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T01:55:13.020 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:13.020 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-09-30T01:55:13.035 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-09-30T01:55:13.035 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:13.035 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T01:55:13.052 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T01:55:13.109 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:13.109 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/daemon-helper 2023-09-30T01:55:13.125 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-09-30T01:55:13.179 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-09-30T01:55:13.179 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:13.179 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T01:55:13.195 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T01:55:13.251 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:13.251 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/adjust-ulimits 2023-09-30T01:55:13.266 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-09-30T01:55:13.276 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-09-30T01:55:13.276 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:13.276 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T01:55:13.292 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T01:55:13.303 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:13.303 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/usr/bin/stdin-killer 2023-09-30T01:55:13.316 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-09-30T01:55:13.372 INFO:teuthology.run_tasks:Running task ceph... 2023-09-30T01:55:13.448 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-09-30T01:55:13.448 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 777 /var/log/ceph 2023-09-30T01:55:13.451 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 777 /var/log/ceph 2023-09-30T01:55:13.466 INFO:tasks.ceph:Disabling ceph logrotate... 2023-09-30T01:55:13.467 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T01:55:13.469 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/logrotate.d/ceph 2023-09-30T01:55:13.479 INFO:tasks.ceph:Creating extra log directories... 2023-09-30T01:55:13.479 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T01:55:13.481 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-09-30T01:55:13.544 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-09-30T01:55:13.544 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-09-30T01:55:13.544 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-09-30T01:55:13.544 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:13.544 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-30T01:55:13.551 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-30T01:55:13.588 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:13.589 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-09-30T01:55:13.595 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-09-30T01:55:13.639 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-09-30T01:55:13.639 INFO:tasks.ceph:config {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 0}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(RECENT_CRASH\\)', 'replacing it with standby', 'No standby daemons available', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-09-30T01:55:13.639 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126', 'branch': 'wip-yuri4-testing-2023-09-29-0928-quincy', 'description': 'rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/crash}', 'email': 'yweinste@redhat.com', 'first_in_suite': False, 'job_id': '7407126', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 2, 'size': 30}}], 'os_type': 'ubuntu', 'os_version': '20.04', 'overrides': {'admin_socket': {'branch': 'wip-yuri4-testing-2023-09-29-0928-quincy'}, 'ceph': {'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 0}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri4-testing-2023-09-29-0928-quincy', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481'}}, 'owner': 'scheduled_yuriw@teuthology', 'priority': 75, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mgr.x', 'mon.a', 'mon.c', 'mds.a', 'mds.c', 'osd.0', 'client.0'], ['mgr.y', 'mgr.z', 'mon.b', 'mds.b', 'osd.1', 'osd.2', 'osd.3', 'client.1']], 'seed': 9810, 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481', 'sleep_before_teardown': 0, 'subset': '111/120000', 'suite': 'rados', 'suite_branch': 'wip-yuri4-testing-2023-09-29-0928-quincy', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph-ci.git', 'suite_sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481', 'targets': {'smithi055.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM=', 'smithi133.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'log-ignorelist': ['overall HEALTH_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(RECENT_CRASH\\)', 'replacing it with standby', 'No standby daemons available', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'wait-for-scrub': False, 'conf': {'client': {'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'global': {'mon election default strategy': 3}, 'mds': {'debug mgrc': 20}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1, 'mgr ttl cache expire seconds': 0}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'sha1': '93dce5e17918f8aca65993a7a2dc40233a47b481', 'cluster': 'ceph'}}, {'cephfs_test_runner': {'modules': ['tasks.mgr.test_crash']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-09-29_19:38:56', 'tube': 'smithi', 'user': 'yuriw', 'verbose': True, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-09-30T01:55:13.640 DEBUG:teuthology.orchestra.run.smithi055:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T01:55:13.642 DEBUG:teuthology.orchestra.run.smithi133:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-09-30T01:55:13.684 DEBUG:teuthology.orchestra.run.smithi055:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T01:55:13.686 DEBUG:teuthology.orchestra.run.smithi133:> sudo install -d -m0777 -- /var/run/ceph 2023-09-30T01:55:13.703 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:13.703 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T01:55:13.751 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T01:55:13.751 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_1 2023-09-30T01:55:13.758 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T01:55:13.758 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T01:55:13.759 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 361 Links: 1 2023-09-30T01:55:13.759 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T01:55:13.759 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-09-30 01:51:34.373712163 +0000 2023-09-30T01:55:13.759 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-09-30 01:51:34.369712254 +0000 2023-09-30T01:55:13.759 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-09-30 01:51:34.369712254 +0000 2023-09-30T01:55:13.759 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2023-09-30T01:55:13.759 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T01:55:13.772 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-09-30T01:55:13.772 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-09-30T01:55:13.772 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000501512 s, 1.0 MB/s 2023-09-30T01:55:13.773 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T01:55:13.781 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_2 2023-09-30T01:55:13.788 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T01:55:13.788 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T01:55:13.788 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 367 Links: 1 2023-09-30T01:55:13.788 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T01:55:13.789 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-09-30 01:51:35.153694217 +0000 2023-09-30T01:55:13.789 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-09-30 01:51:34.877700567 +0000 2023-09-30T01:55:13.789 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-09-30 01:51:34.877700567 +0000 2023-09-30T01:55:13.789 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2023-09-30T01:55:13.789 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T01:55:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-09-30T01:55:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-09-30T01:55:13.802 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000487386 s, 1.1 MB/s 2023-09-30T01:55:13.803 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T01:55:13.853 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_3 2023-09-30T01:55:13.861 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T01:55:13.861 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T01:55:13.861 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 373 Links: 1 2023-09-30T01:55:13.861 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T01:55:13.861 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-09-30 01:51:35.665682438 +0000 2023-09-30T01:55:13.861 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-09-30 01:51:35.373689155 +0000 2023-09-30T01:55:13.861 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-09-30 01:51:35.373689155 +0000 2023-09-30T01:55:13.861 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2023-09-30T01:55:13.862 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T01:55:13.875 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-09-30T01:55:13.876 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-09-30T01:55:13.876 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000417144 s, 1.2 MB/s 2023-09-30T01:55:13.877 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T01:55:13.885 DEBUG:teuthology.orchestra.run.smithi055:> stat /dev/vg_nvme/lv_4 2023-09-30T01:55:13.940 INFO:teuthology.orchestra.run.smithi055.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T01:55:13.940 INFO:teuthology.orchestra.run.smithi055.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T01:55:13.940 INFO:teuthology.orchestra.run.smithi055.stdout:Device: 6h/6d Inode: 380 Links: 1 2023-09-30T01:55:13.940 INFO:teuthology.orchestra.run.smithi055.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T01:55:13.940 INFO:teuthology.orchestra.run.smithi055.stdout:Access: 2023-09-30 01:51:35.893677193 +0000 2023-09-30T01:55:13.940 INFO:teuthology.orchestra.run.smithi055.stdout:Modify: 2023-09-30 01:51:35.889677284 +0000 2023-09-30T01:55:13.940 INFO:teuthology.orchestra.run.smithi055.stdout:Change: 2023-09-30 01:51:35.889677284 +0000 2023-09-30T01:55:13.941 INFO:teuthology.orchestra.run.smithi055.stdout: Birth: - 2023-09-30T01:55:13.941 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T01:55:13.953 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records in 2023-09-30T01:55:13.953 INFO:teuthology.orchestra.run.smithi055.stderr:1+0 records out 2023-09-30T01:55:13.953 INFO:teuthology.orchestra.run.smithi055.stderr:512 bytes copied, 0.000469216 s, 1.1 MB/s 2023-09-30T01:55:13.954 DEBUG:teuthology.orchestra.run.smithi055:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T01:55:13.962 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-09-30T01:55:13.963 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:13.963 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/scratch_devs of=/dev/stdout 2023-09-30T01:55:13.969 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-09-30T01:55:13.970 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_1 2023-09-30T01:55:14.020 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-09-30T01:55:14.020 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T01:55:14.021 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 360 Links: 1 2023-09-30T01:55:14.021 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T01:55:14.021 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-09-30 01:51:32.293519881 +0000 2023-09-30T01:55:14.021 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-09-30 01:51:31.989526878 +0000 2023-09-30T01:55:14.021 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-09-30 01:51:31.989526878 +0000 2023-09-30T01:55:14.021 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-09-30T01:55:14.021 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-09-30T01:55:14.037 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-09-30T01:55:14.038 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-09-30T01:55:14.038 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000392445 s, 1.3 MB/s 2023-09-30T01:55:14.038 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-09-30T01:55:14.046 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_2 2023-09-30T01:55:14.096 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-09-30T01:55:14.096 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T01:55:14.096 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 367 Links: 1 2023-09-30T01:55:14.097 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T01:55:14.097 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-09-30 01:51:32.793508371 +0000 2023-09-30T01:55:14.097 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-09-30 01:51:32.505515001 +0000 2023-09-30T01:55:14.097 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-09-30 01:51:32.505515001 +0000 2023-09-30T01:55:14.097 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-09-30T01:55:14.097 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-09-30T01:55:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-09-30T01:55:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-09-30T01:55:14.110 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000383436 s, 1.3 MB/s 2023-09-30T01:55:14.111 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-09-30T01:55:14.120 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_3 2023-09-30T01:55:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-09-30T01:55:14.168 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T01:55:14.168 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 370 Links: 1 2023-09-30T01:55:14.169 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T01:55:14.169 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-09-30 01:51:33.021503123 +0000 2023-09-30T01:55:14.169 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-09-30 01:51:33.017503216 +0000 2023-09-30T01:55:14.169 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-09-30 01:51:33.017503216 +0000 2023-09-30T01:55:14.169 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-09-30T01:55:14.169 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-09-30T01:55:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-09-30T01:55:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-09-30T01:55:14.183 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000391519 s, 1.3 MB/s 2023-09-30T01:55:14.184 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-09-30T01:55:14.192 DEBUG:teuthology.orchestra.run.smithi133:> stat /dev/vg_nvme/lv_4 2023-09-30T01:55:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-09-30T01:55:14.198 INFO:teuthology.orchestra.run.smithi133.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-09-30T01:55:14.198 INFO:teuthology.orchestra.run.smithi133.stdout:Device: 6h/6d Inode: 380 Links: 1 2023-09-30T01:55:14.198 INFO:teuthology.orchestra.run.smithi133.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-09-30T01:55:14.198 INFO:teuthology.orchestra.run.smithi133.stdout:Access: 2023-09-30 01:51:33.829484525 +0000 2023-09-30T01:55:14.199 INFO:teuthology.orchestra.run.smithi133.stdout:Modify: 2023-09-30 01:51:33.561490693 +0000 2023-09-30T01:55:14.199 INFO:teuthology.orchestra.run.smithi133.stdout:Change: 2023-09-30 01:51:33.561490693 +0000 2023-09-30T01:55:14.199 INFO:teuthology.orchestra.run.smithi133.stdout: Birth: - 2023-09-30T01:55:14.199 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-09-30T01:55:14.254 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records in 2023-09-30T01:55:14.254 INFO:teuthology.orchestra.run.smithi133.stderr:1+0 records out 2023-09-30T01:55:14.254 INFO:teuthology.orchestra.run.smithi133.stderr:512 bytes copied, 0.000394905 s, 1.3 MB/s 2023-09-30T01:55:14.255 DEBUG:teuthology.orchestra.run.smithi133:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-09-30T01:55:14.264 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-09-30T01:55:14.265 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2023-09-30T01:55:14.265 INFO:tasks.ceph:Generating config... 2023-09-30T01:55:14.266 INFO:tasks.ceph:[client] debug client = 20 2023-09-30T01:55:14.266 INFO:tasks.ceph:[client] debug mgrc = 20 2023-09-30T01:55:14.266 INFO:tasks.ceph:[client] debug ms = 1 2023-09-30T01:55:14.266 INFO:tasks.ceph:[global] mon election default strategy = 3 2023-09-30T01:55:14.266 INFO:tasks.ceph:[mds] debug mgrc = 20 2023-09-30T01:55:14.266 INFO:tasks.ceph:[mgr] debug client = 20 2023-09-30T01:55:14.266 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-09-30T01:55:14.267 INFO:tasks.ceph:[mgr] debug ms = 1 2023-09-30T01:55:14.267 INFO:tasks.ceph:[mgr] mgr ttl cache expire seconds = 0 2023-09-30T01:55:14.267 INFO:tasks.ceph:[mon] debug mon = 20 2023-09-30T01:55:14.267 INFO:tasks.ceph:[mon] debug ms = 1 2023-09-30T01:55:14.267 INFO:tasks.ceph:[mon] debug paxos = 20 2023-09-30T01:55:14.267 INFO:tasks.ceph:[osd] bdev async discard = True 2023-09-30T01:55:14.267 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-09-30T01:55:14.267 INFO:tasks.ceph:[osd] bluestore allocator = stupid 2023-09-30T01:55:14.267 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-09-30T01:55:14.267 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-09-30T01:55:14.267 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-09-30T01:55:14.267 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-09-30T01:55:14.267 INFO:tasks.ceph:[osd] debug mgrc = 20 2023-09-30T01:55:14.268 INFO:tasks.ceph:[osd] debug ms = 1 2023-09-30T01:55:14.268 INFO:tasks.ceph:[osd] debug osd = 20 2023-09-30T01:55:14.268 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-09-30T01:55:14.268 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-09-30T01:55:14.268 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-09-30T01:55:14.268 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-09-30T01:55:14.268 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-09-30T01:55:14.268 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-09-30T01:55:14.268 INFO:tasks.ceph:Setting up mon.a... 2023-09-30T01:55:14.269 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-09-30T01:55:14.304 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.keyring 2023-09-30T01:55:14.307 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-09-30T01:55:14.341 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T01:55:14.355 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.55'), ('mon.c', '[v2:172.21.15.55:3301,v1:172.21.15.55:6790]'), ('mon.b', '172.21.15.133')] 2023-09-30T01:55:14.355 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790],172.21.15.133', 'mon election default strategy': 3}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'stupid', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug mgrc': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'mgr ttl cache expire seconds': 0}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug client': 20, 'debug mgrc': 20, 'debug ms': 1}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds': {'debug mgrc': 20}} 2023-09-30T01:55:14.356 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:14.356 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T01:55:14.403 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.55 --addv c '[v2:172.21.15.55:3301,v1:172.21.15.55:6790]' --add b 172.21.15.133 --print /home/ubuntu/cephtest/ceph.monmap 2023-09-30T01:55:14.442 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-09-30T01:55:14.442 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: generated fsid 37496c89-c485-46e5-8550-5722d2abf46a 2023-09-30T01:55:14.443 INFO:teuthology.orchestra.run.smithi055.stdout:setting min_mon_release = octopus 2023-09-30T01:55:14.443 INFO:teuthology.orchestra.run.smithi055.stdout:epoch 0 2023-09-30T01:55:14.443 INFO:teuthology.orchestra.run.smithi055.stdout:fsid 37496c89-c485-46e5-8550-5722d2abf46a 2023-09-30T01:55:14.443 INFO:teuthology.orchestra.run.smithi055.stdout:last_changed 2023-09-30T01:55:14.443294+0000 2023-09-30T01:55:14.443 INFO:teuthology.orchestra.run.smithi055.stdout:created 2023-09-30T01:55:14.443294+0000 2023-09-30T01:55:14.443 INFO:teuthology.orchestra.run.smithi055.stdout:min_mon_release 15 (octopus) 2023-09-30T01:55:14.443 INFO:teuthology.orchestra.run.smithi055.stdout:election_strategy: 3 2023-09-30T01:55:14.443 INFO:teuthology.orchestra.run.smithi055.stdout:0: [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] mon.a 2023-09-30T01:55:14.443 INFO:teuthology.orchestra.run.smithi055.stdout:1: [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] mon.b 2023-09-30T01:55:14.444 INFO:teuthology.orchestra.run.smithi055.stdout:2: [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] mon.c 2023-09-30T01:55:14.444 INFO:teuthology.orchestra.run.smithi055.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-09-30T01:55:14.445 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-09-30T01:55:14.449 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 37496c89-c485-46e5-8550-5722d2abf46a... 2023-09-30T01:55:14.450 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T01:55:14.452 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-09-30T01:55:14.484 INFO:teuthology.orchestra.run.smithi055.stdout:[global] 2023-09-30T01:55:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: chdir = "" 2023-09-30T01:55:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T01:55:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: auth supported = cephx 2023-09-30T01:55:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: filestore xattr use omap = true 2023-09-30T01:55:14.484 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: mon clock drift allowed = 1.000 2023-09-30T01:55:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: osd crush chooseleaf type = 0 2023-09-30T01:55:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: auth debug = true 2023-09-30T01:55:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on old message = true 2023-09-30T01:55:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: ms die on bug = true 2023-09-30T01:55:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.485 INFO:teuthology.orchestra.run.smithi055.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T01:55:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: mon pg warn max object skew = 0 2023-09-30T01:55:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T01:55:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T01:55:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default size = 2 2023-09-30T01:55:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow primary affinity = true 2023-09-30T01:55:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd allow pg remap = true 2023-09-30T01:55:14.486 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on legacy crush tunables = false 2023-09-30T01:55:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on crush straw calc version zero = false 2023-09-30T01:55:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on no sortbitwise = false 2023-09-30T01:55:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on osd down out interval zero = false 2023-09-30T01:55:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: mon warn on too few osds = false 2023-09-30T01:55:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T01:55:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T01:55:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: mon_allow_pool_size_one = true 2023-09-30T01:55:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.487 INFO:teuthology.orchestra.run.smithi055.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T01:55:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: osd default data pool replay window = 5 2023-09-30T01:55:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: mon allow pool delete = true 2023-09-30T01:55:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: mon cluster log file level = debug 2023-09-30T01:55:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: debug asserts on shutdown = true 2023-09-30T01:55:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: mon health detail to clog = false 2023-09-30T01:55:14.488 INFO:teuthology.orchestra.run.smithi055.stdout: mon host = "172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790],172.21.15.133" 2023-09-30T01:55:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: mon election default strategy = 3 2023-09-30T01:55:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: fsid = 37496c89-c485-46e5-8550-5722d2abf46a 2023-09-30T01:55:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.489 INFO:teuthology.orchestra.run.smithi055.stdout:[osd] 2023-09-30T01:55:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: osd journal size = 100 2023-09-30T01:55:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub load threshold = 5.0 2023-09-30T01:55:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: osd scrub max interval = 600 2023-09-30T01:55:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: osd mclock profile = high_recovery_ops 2023-09-30T01:55:14.489 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: osd recover clone overlap = true 2023-09-30T01:55:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: osd recovery max chunk = 1048576 2023-09-30T01:55:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug shutdown = true 2023-09-30T01:55:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug op order = true 2023-09-30T01:55:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug verify stray on activate = true 2023-09-30T01:55:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: osd open classes on start = true 2023-09-30T01:55:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug pg log writeout = true 2023-09-30T01:55:14.490 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: osd deep scrub update digest min age = 30 2023-09-30T01:55:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: osd map max advance = 10 2023-09-30T01:55:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: journal zero on create = true 2023-09-30T01:55:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: filestore ondisk finisher threads = 3 2023-09-30T01:55:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: filestore apply finisher threads = 3 2023-09-30T01:55:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.491 INFO:teuthology.orchestra.run.smithi055.stdout: bdev debug aio = true 2023-09-30T01:55:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: osd debug misdirected ops = true 2023-09-30T01:55:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: bdev async discard = True 2023-09-30T01:55:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: bdev enable discard = True 2023-09-30T01:55:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore allocator = stupid 2023-09-30T01:55:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore block size = 96636764160 2023-09-30T01:55:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: bluestore fsck on mount = True 2023-09-30T01:55:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluefs = 20 2023-09-30T01:55:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: debug bluestore = 20 2023-09-30T01:55:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgrc = 20 2023-09-30T01:55:14.492 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-09-30T01:55:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: debug osd = 20 2023-09-30T01:55:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: debug rocksdb = 10 2023-09-30T01:55:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T01:55:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd full ratio = 0.9 2023-09-30T01:55:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd nearfull ratio = 0.8 2023-09-30T01:55:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: osd failsafe full ratio = 0.95 2023-09-30T01:55:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: osd objectstore = bluestore 2023-09-30T01:55:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.493 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr] 2023-09-30T01:55:14.493 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-09-30T01:55:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgr = 20 2023-09-30T01:55:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2023-09-30T01:55:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2023-09-30T01:55:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2023-09-30T01:55:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2023-09-30T01:55:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: mgr/telemetry/nag = false 2023-09-30T01:55:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2023-09-30T01:55:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: mgr ttl cache expire seconds = 0 2023-09-30T01:55:14.494 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.495 INFO:teuthology.orchestra.run.smithi055.stdout:[mon] 2023-09-30T01:55:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-09-30T01:55:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: debug mon = 20 2023-09-30T01:55:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: debug paxos = 20 2023-09-30T01:55:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: debug auth = 20 2023-09-30T01:55:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: mon data avail warn = 5 2023-09-30T01:55:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: mon mgr mkfs grace = 240 2023-09-30T01:55:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min pgs per osd = 4 2023-09-30T01:55:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd reporter subtree level = osd 2023-09-30T01:55:14.495 INFO:teuthology.orchestra.run.smithi055.stdout: mon osd prime pg temp = true 2023-09-30T01:55:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: mon reweight min bytes per osd = 10 2023-09-30T01:55:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T01:55:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T01:55:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T01:55:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T01:55:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T01:55:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T01:55:14.496 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: # 1m isn't quite enough 2023-09-30T01:55:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: mon_down_mkfs_grace = 2m 2023-09-30T01:55:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: mon_warn_on_filestore_osds = false 2023-09-30T01:55:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:14.497 INFO:teuthology.orchestra.run.smithi055.stdout:[client] 2023-09-30T01:55:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: rgw cache enabled = true 2023-09-30T01:55:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable ops log = true 2023-09-30T01:55:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: rgw enable usage log = true 2023-09-30T01:55:14.497 INFO:teuthology.orchestra.run.smithi055.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T01:55:14.498 INFO:teuthology.orchestra.run.smithi055.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T01:55:14.498 INFO:teuthology.orchestra.run.smithi055.stdout: debug client = 20 2023-09-30T01:55:14.498 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgrc = 20 2023-09-30T01:55:14.498 INFO:teuthology.orchestra.run.smithi055.stdout: debug ms = 1 2023-09-30T01:55:14.498 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.a] 2023-09-30T01:55:14.498 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.c] 2023-09-30T01:55:14.498 INFO:teuthology.orchestra.run.smithi055.stdout:[mon.b] 2023-09-30T01:55:14.498 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2023-09-30T01:55:14.498 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2023-09-30T01:55:14.498 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2023-09-30T01:55:14.499 INFO:teuthology.orchestra.run.smithi055.stdout:[mds] 2023-09-30T01:55:14.499 INFO:teuthology.orchestra.run.smithi055.stdout: debug mgrc = 20 2023-09-30T01:55:14.500 INFO:teuthology.orchestra.run.smithi133.stdout:[global] 2023-09-30T01:55:14.500 INFO:teuthology.orchestra.run.smithi133.stdout: chdir = "" 2023-09-30T01:55:14.500 INFO:teuthology.orchestra.run.smithi133.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-09-30T01:55:14.501 INFO:teuthology.orchestra.run.smithi133.stdout: auth supported = cephx 2023-09-30T01:55:14.501 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.501 INFO:teuthology.orchestra.run.smithi133.stdout: filestore xattr use omap = true 2023-09-30T01:55:14.501 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.501 INFO:teuthology.orchestra.run.smithi133.stdout: mon clock drift allowed = 1.000 2023-09-30T01:55:14.501 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.501 INFO:teuthology.orchestra.run.smithi133.stdout: osd crush chooseleaf type = 0 2023-09-30T01:55:14.501 INFO:teuthology.orchestra.run.smithi133.stdout: auth debug = true 2023-09-30T01:55:14.501 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.501 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on old message = true 2023-09-30T01:55:14.502 INFO:teuthology.orchestra.run.smithi133.stdout: ms die on bug = true 2023-09-30T01:55:14.502 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.502 INFO:teuthology.orchestra.run.smithi133.stdout: mon max pg per osd = 10000 # >= luminous 2023-09-30T01:55:14.502 INFO:teuthology.orchestra.run.smithi133.stdout: mon pg warn max object skew = 0 2023-09-30T01:55:14.502 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.502 INFO:teuthology.orchestra.run.smithi133.stdout: # disable pg_autoscaler by default for new pools 2023-09-30T01:55:14.502 INFO:teuthology.orchestra.run.smithi133.stdout: osd_pool_default_pg_autoscale_mode = off 2023-09-30T01:55:14.502 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.502 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default size = 2 2023-09-30T01:55:14.503 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.503 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow primary affinity = true 2023-09-30T01:55:14.503 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd allow pg remap = true 2023-09-30T01:55:14.503 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on legacy crush tunables = false 2023-09-30T01:55:14.503 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on crush straw calc version zero = false 2023-09-30T01:55:14.503 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on no sortbitwise = false 2023-09-30T01:55:14.503 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on osd down out interval zero = false 2023-09-30T01:55:14.503 INFO:teuthology.orchestra.run.smithi133.stdout: mon warn on too few osds = false 2023-09-30T01:55:14.503 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-09-30T01:55:14.503 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_pool_no_redundancy = false 2023-09-30T01:55:14.504 INFO:teuthology.orchestra.run.smithi133.stdout: mon_allow_pool_size_one = true 2023-09-30T01:55:14.504 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.504 INFO:teuthology.orchestra.run.smithi133.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-09-30T01:55:14.504 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.504 INFO:teuthology.orchestra.run.smithi133.stdout: osd default data pool replay window = 5 2023-09-30T01:55:14.504 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.504 INFO:teuthology.orchestra.run.smithi133.stdout: mon allow pool delete = true 2023-09-30T01:55:14.504 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.504 INFO:teuthology.orchestra.run.smithi133.stdout: mon cluster log file level = debug 2023-09-30T01:55:14.504 INFO:teuthology.orchestra.run.smithi133.stdout: debug asserts on shutdown = true 2023-09-30T01:55:14.505 INFO:teuthology.orchestra.run.smithi133.stdout: mon health detail to clog = false 2023-09-30T01:55:14.505 INFO:teuthology.orchestra.run.smithi133.stdout: mon host = "172.21.15.55,[v2:172.21.15.55:3301,v1:172.21.15.55:6790],172.21.15.133" 2023-09-30T01:55:14.505 INFO:teuthology.orchestra.run.smithi133.stdout: mon election default strategy = 3 2023-09-30T01:55:14.505 INFO:teuthology.orchestra.run.smithi133.stdout: fsid = 37496c89-c485-46e5-8550-5722d2abf46a 2023-09-30T01:55:14.505 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.505 INFO:teuthology.orchestra.run.smithi133.stdout:[osd] 2023-09-30T01:55:14.506 INFO:teuthology.orchestra.run.smithi133.stdout: osd journal size = 100 2023-09-30T01:55:14.506 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.506 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub load threshold = 5.0 2023-09-30T01:55:14.506 INFO:teuthology.orchestra.run.smithi133.stdout: osd scrub max interval = 600 2023-09-30T01:55:14.506 INFO:teuthology.orchestra.run.smithi133.stdout: osd mclock profile = high_recovery_ops 2023-09-30T01:55:14.506 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.506 INFO:teuthology.orchestra.run.smithi133.stdout: osd recover clone overlap = true 2023-09-30T01:55:14.506 INFO:teuthology.orchestra.run.smithi133.stdout: osd recovery max chunk = 1048576 2023-09-30T01:55:14.506 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.506 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug shutdown = true 2023-09-30T01:55:14.507 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug op order = true 2023-09-30T01:55:14.507 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug verify stray on activate = true 2023-09-30T01:55:14.507 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.507 INFO:teuthology.orchestra.run.smithi133.stdout: osd open classes on start = true 2023-09-30T01:55:14.507 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug pg log writeout = true 2023-09-30T01:55:14.507 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.507 INFO:teuthology.orchestra.run.smithi133.stdout: osd deep scrub update digest min age = 30 2023-09-30T01:55:14.507 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.507 INFO:teuthology.orchestra.run.smithi133.stdout: osd map max advance = 10 2023-09-30T01:55:14.507 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.508 INFO:teuthology.orchestra.run.smithi133.stdout: journal zero on create = true 2023-09-30T01:55:14.508 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.508 INFO:teuthology.orchestra.run.smithi133.stdout: filestore ondisk finisher threads = 3 2023-09-30T01:55:14.508 INFO:teuthology.orchestra.run.smithi133.stdout: filestore apply finisher threads = 3 2023-09-30T01:55:14.508 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.508 INFO:teuthology.orchestra.run.smithi133.stdout: bdev debug aio = true 2023-09-30T01:55:14.508 INFO:teuthology.orchestra.run.smithi133.stdout: osd debug misdirected ops = true 2023-09-30T01:55:14.508 INFO:teuthology.orchestra.run.smithi133.stdout: bdev async discard = True 2023-09-30T01:55:14.508 INFO:teuthology.orchestra.run.smithi133.stdout: bdev enable discard = True 2023-09-30T01:55:14.508 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore allocator = stupid 2023-09-30T01:55:14.509 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore block size = 96636764160 2023-09-30T01:55:14.509 INFO:teuthology.orchestra.run.smithi133.stdout: bluestore fsck on mount = True 2023-09-30T01:55:14.509 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluefs = 20 2023-09-30T01:55:14.509 INFO:teuthology.orchestra.run.smithi133.stdout: debug bluestore = 20 2023-09-30T01:55:14.509 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgrc = 20 2023-09-30T01:55:14.509 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-09-30T01:55:14.509 INFO:teuthology.orchestra.run.smithi133.stdout: debug osd = 20 2023-09-30T01:55:14.509 INFO:teuthology.orchestra.run.smithi133.stdout: debug rocksdb = 10 2023-09-30T01:55:14.509 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd backfillfull_ratio = 0.85 2023-09-30T01:55:14.510 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd full ratio = 0.9 2023-09-30T01:55:14.510 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd nearfull ratio = 0.8 2023-09-30T01:55:14.510 INFO:teuthology.orchestra.run.smithi133.stdout: osd failsafe full ratio = 0.95 2023-09-30T01:55:14.510 INFO:teuthology.orchestra.run.smithi133.stdout: osd objectstore = bluestore 2023-09-30T01:55:14.510 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.510 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr] 2023-09-30T01:55:14.510 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-09-30T01:55:14.510 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgr = 20 2023-09-30T01:55:14.510 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2023-09-30T01:55:14.510 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2023-09-30T01:55:14.511 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2023-09-30T01:55:14.511 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2023-09-30T01:55:14.511 INFO:teuthology.orchestra.run.smithi133.stdout: mgr/telemetry/nag = false 2023-09-30T01:55:14.511 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2023-09-30T01:55:14.511 INFO:teuthology.orchestra.run.smithi133.stdout: mgr ttl cache expire seconds = 0 2023-09-30T01:55:14.511 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.511 INFO:teuthology.orchestra.run.smithi133.stdout:[mon] 2023-09-30T01:55:14.511 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-09-30T01:55:14.511 INFO:teuthology.orchestra.run.smithi133.stdout: debug mon = 20 2023-09-30T01:55:14.511 INFO:teuthology.orchestra.run.smithi133.stdout: debug paxos = 20 2023-09-30T01:55:14.512 INFO:teuthology.orchestra.run.smithi133.stdout: debug auth = 20 2023-09-30T01:55:14.512 INFO:teuthology.orchestra.run.smithi133.stdout: mon data avail warn = 5 2023-09-30T01:55:14.512 INFO:teuthology.orchestra.run.smithi133.stdout: mon mgr mkfs grace = 240 2023-09-30T01:55:14.512 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min pgs per osd = 4 2023-09-30T01:55:14.512 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd reporter subtree level = osd 2023-09-30T01:55:14.512 INFO:teuthology.orchestra.run.smithi133.stdout: mon osd prime pg temp = true 2023-09-30T01:55:14.512 INFO:teuthology.orchestra.run.smithi133.stdout: mon reweight min bytes per osd = 10 2023-09-30T01:55:14.512 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.512 INFO:teuthology.orchestra.run.smithi133.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-09-30T01:55:14.512 INFO:teuthology.orchestra.run.smithi133.stdout: auth mon ticket ttl = 660 # 11m 2023-09-30T01:55:14.512 INFO:teuthology.orchestra.run.smithi133.stdout: auth service ticket ttl = 240 # 4m 2023-09-30T01:55:14.513 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.513 INFO:teuthology.orchestra.run.smithi133.stdout: # don't complain about insecure global_id in the test suite 2023-09-30T01:55:14.513 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-09-30T01:55:14.513 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-09-30T01:55:14.513 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.513 INFO:teuthology.orchestra.run.smithi133.stdout: # 1m isn't quite enough 2023-09-30T01:55:14.513 INFO:teuthology.orchestra.run.smithi133.stdout: mon_down_mkfs_grace = 2m 2023-09-30T01:55:14.513 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.513 INFO:teuthology.orchestra.run.smithi133.stdout: mon_warn_on_filestore_osds = false 2023-09-30T01:55:14.513 INFO:teuthology.orchestra.run.smithi133.stdout: 2023-09-30T01:55:14.514 INFO:teuthology.orchestra.run.smithi133.stdout:[client] 2023-09-30T01:55:14.514 INFO:teuthology.orchestra.run.smithi133.stdout: rgw cache enabled = true 2023-09-30T01:55:14.514 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable ops log = true 2023-09-30T01:55:14.514 INFO:teuthology.orchestra.run.smithi133.stdout: rgw enable usage log = true 2023-09-30T01:55:14.514 INFO:teuthology.orchestra.run.smithi133.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-09-30T01:55:14.514 INFO:teuthology.orchestra.run.smithi133.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-09-30T01:55:14.514 INFO:teuthology.orchestra.run.smithi133.stdout: debug client = 20 2023-09-30T01:55:14.514 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgrc = 20 2023-09-30T01:55:14.514 INFO:teuthology.orchestra.run.smithi133.stdout: debug ms = 1 2023-09-30T01:55:14.514 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.a] 2023-09-30T01:55:14.515 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.c] 2023-09-30T01:55:14.515 INFO:teuthology.orchestra.run.smithi133.stdout:[mon.b] 2023-09-30T01:55:14.515 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2023-09-30T01:55:14.515 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2023-09-30T01:55:14.515 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2023-09-30T01:55:14.515 INFO:teuthology.orchestra.run.smithi133.stdout:[mds] 2023-09-30T01:55:14.515 INFO:teuthology.orchestra.run.smithi133.stdout: debug mgrc = 20 2023-09-30T01:55:14.515 INFO:tasks.ceph:Creating admin key on mon.a... 2023-09-30T01:55:14.516 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-09-30T01:55:14.588 INFO:tasks.ceph:Copying monmap to all nodes... 2023-09-30T01:55:14.588 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:14.589 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-09-30T01:55:14.596 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:14.596 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-09-30T01:55:14.603 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi055.front.sepia.ceph.com 2023-09-30T01:55:14.603 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:14.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T01:55:14.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T01:55:14.670 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:14.670 DEBUG:teuthology.orchestra.run.smithi055:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T01:55:14.677 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi133.front.sepia.ceph.com 2023-09-30T01:55:14.677 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:14.677 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd of=/etc/ceph/ceph.keyring 2023-09-30T01:55:14.677 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-09-30T01:55:14.704 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:14.704 DEBUG:teuthology.orchestra.run.smithi133:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-09-30T01:55:14.711 INFO:tasks.ceph:Setting up mon nodes... 2023-09-30T01:55:14.711 INFO:tasks.ceph:Setting up mgr nodes... 2023-09-30T01:55:14.711 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T01:55:14.757 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-09-30T01:55:14.760 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-09-30T01:55:14.806 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-09-30T01:55:14.808 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mgr/ceph-z && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.z /var/lib/ceph/mgr/ceph-z/keyring 2023-09-30T01:55:14.895 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mgr/ceph-z/keyring 2023-09-30T01:55:14.897 INFO:tasks.ceph:Setting up mds nodes... 2023-09-30T01:55:14.897 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T01:55:14.946 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-09-30T01:55:14.948 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-09-30T01:55:14.963 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-09-30T01:55:15.007 INFO:teuthology.orchestra.run.smithi055.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-09-30T01:55:15.009 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-09-30T01:55:15.069 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-09-30T01:55:15.117 INFO:teuthology.orchestra.run.smithi133.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-09-30T01:55:15.120 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-09-30T01:55:15.133 INFO:tasks.ceph_client:Setting up client nodes... 2023-09-30T01:55:15.134 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-09-30T01:55:15.170 INFO:teuthology.orchestra.run.smithi055.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-09-30T01:55:15.184 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-09-30T01:55:15.219 INFO:teuthology.orchestra.run.smithi133.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-09-30T01:55:15.231 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-09-30T01:55:15.232 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi055.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi133.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2023-09-30T01:55:15.232 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-09-30T01:55:15.248 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2023-09-30T01:55:15.249 INFO:tasks.ceph:role: osd.0 2023-09-30T01:55:15.249 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com 2023-09-30T01:55:15.249 DEBUG:teuthology.orchestra.run.smithi055:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T01:55:16.639 INFO:teuthology.orchestra.run.smithi055.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T01:55:16.639 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T01:55:16.639 INFO:teuthology.orchestra.run.smithi055.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T01:55:16.639 INFO:teuthology.orchestra.run.smithi055.stdout: = reflink=1 2023-09-30T01:55:16.639 INFO:teuthology.orchestra.run.smithi055.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T01:55:16.639 INFO:teuthology.orchestra.run.smithi055.stdout: = sunit=0 swidth=0 blks 2023-09-30T01:55:16.640 INFO:teuthology.orchestra.run.smithi055.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T01:55:16.640 INFO:teuthology.orchestra.run.smithi055.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T01:55:16.640 INFO:teuthology.orchestra.run.smithi055.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T01:55:16.640 INFO:teuthology.orchestra.run.smithi055.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T01:55:16.641 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi055.front.sepia.ceph.com -o noatime 2023-09-30T01:55:16.641 DEBUG:teuthology.orchestra.run.smithi055:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-09-30T01:55:16.668 DEBUG:teuthology.orchestra.run.smithi055:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-09-30T01:55:16.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T01:55:16.679 INFO:teuthology.orchestra.run.smithi055.stderr:sudo: /sbin/restorecon: command not found 2023-09-30T01:55:16.679 DEBUG:teuthology.orchestra.run.smithi055:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T01:55:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:16.793+0000 7f5524dcb3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-09-30T01:55:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:16.793+0000 7f5524dcb3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-09-30T01:55:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:16.793+0000 7f5524dcb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T01:55:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:16.793+0000 7f5524dcb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T01:55:16.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:16.793+0000 7f5524dcb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-09-30T01:55:16.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:16.793+0000 7f5524dcb3c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-09-30T01:55:17.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:17.373+0000 7f5524dcb3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-30T01:55:18.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:18.165+0000 7f5524dcb3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-30T01:55:18.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:18.941+0000 7f5524dcb3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-30T01:55:19.830 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-09-30T01:55:19.844 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-09-30T01:55:19.861 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-09-30T01:55:19.861 INFO:tasks.ceph:role: osd.1 2023-09-30T01:55:19.861 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com 2023-09-30T01:55:19.862 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-09-30T01:55:20.421 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T01:55:20.422 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T01:55:20.422 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T01:55:20.422 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-09-30T01:55:20.422 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T01:55:20.422 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-09-30T01:55:20.422 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T01:55:20.422 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T01:55:20.422 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T01:55:20.423 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T01:55:20.424 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-09-30T01:55:20.425 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2023-09-30T01:55:20.496 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-09-30T01:55:20.507 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T01:55:20.508 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-09-30T01:55:20.508 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-09-30T01:55:20.566 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-09-30T01:55:20.566 INFO:tasks.ceph:role: osd.2 2023-09-30T01:55:20.566 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com 2023-09-30T01:55:20.567 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-09-30T01:55:21.083 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T01:55:21.083 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T01:55:21.083 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T01:55:21.083 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-09-30T01:55:21.083 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T01:55:21.083 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-09-30T01:55:21.083 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T01:55:21.083 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T01:55:21.083 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T01:55:21.084 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T01:55:21.085 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-09-30T01:55:21.085 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2023-09-30T01:55:21.125 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-09-30T01:55:21.136 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-09-30T01:55:21.137 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T01:55:21.137 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-09-30T01:55:21.196 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2023-09-30T01:55:21.196 INFO:tasks.ceph:role: osd.3 2023-09-30T01:55:21.196 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com 2023-09-30T01:55:21.196 DEBUG:teuthology.orchestra.run.smithi133:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-09-30T01:55:21.646 INFO:teuthology.orchestra.run.smithi133.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-09-30T01:55:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 attr=2, projid32bit=1 2023-09-30T01:55:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-09-30T01:55:21.646 INFO:teuthology.orchestra.run.smithi133.stdout: = reflink=1 2023-09-30T01:55:21.646 INFO:teuthology.orchestra.run.smithi133.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-09-30T01:55:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: = sunit=0 swidth=0 blks 2023-09-30T01:55:21.647 INFO:teuthology.orchestra.run.smithi133.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-09-30T01:55:21.647 INFO:teuthology.orchestra.run.smithi133.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-09-30T01:55:21.647 INFO:teuthology.orchestra.run.smithi133.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-09-30T01:55:21.647 INFO:teuthology.orchestra.run.smithi133.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-09-30T01:55:21.648 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi133.front.sepia.ceph.com -o noatime 2023-09-30T01:55:21.648 DEBUG:teuthology.orchestra.run.smithi133:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2023-09-30T01:55:21.697 DEBUG:teuthology.orchestra.run.smithi133:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-09-30T01:55:21.708 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T01:55:21.708 INFO:teuthology.orchestra.run.smithi133.stderr:sudo: /sbin/restorecon: command not found 2023-09-30T01:55:21.709 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T01:55:21.829 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:21.825+0000 7fdfd429f3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-09-30T01:55:21.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:21.829+0000 7fdfd429f3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-09-30T01:55:21.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:21.829+0000 7fdfd429f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T01:55:21.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:21.829+0000 7fdfd429f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T01:55:21.830 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:21.829+0000 7fdfd429f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-09-30T01:55:21.834 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:21.833+0000 7fdfd429f3c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-09-30T01:55:22.415 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:22.413+0000 7fdfd429f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-30T01:55:23.195 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:23.193+0000 7fdfd429f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-30T01:55:23.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:23.981+0000 7fdfd429f3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-30T01:55:24.834 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-09-30T01:55:24.850 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T01:55:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:24.881+0000 7f8650ca93c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-09-30T01:55:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:24.885+0000 7f8650ca93c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-09-30T01:55:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:24.885+0000 7f8650ca93c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T01:55:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:24.885+0000 7f8650ca93c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T01:55:24.886 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:24.885+0000 7f8650ca93c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-09-30T01:55:24.887 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:24.885+0000 7f8650ca93c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-09-30T01:55:25.448 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:25.445+0000 7f8650ca93c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-30T01:55:26.247 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:26.245+0000 7f8650ca93c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-30T01:55:27.030 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:27.029+0000 7f8650ca93c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-30T01:55:27.886 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-09-30T01:55:27.945 DEBUG:teuthology.orchestra.run.smithi133:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-09-30T01:55:27.984 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:27.981+0000 7fbbfd72a3c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-09-30T01:55:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:27.981+0000 7fbbfd72a3c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-09-30T01:55:27.985 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:27.981+0000 7fbbfd72a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T01:55:27.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:27.981+0000 7fbbfd72a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T01:55:27.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:27.981+0000 7fbbfd72a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-09-30T01:55:27.986 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:27.985+0000 7fbbfd72a3c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-09-30T01:55:28.541 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:28.537+0000 7fbbfd72a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-30T01:55:29.324 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:29.321+0000 7fbbfd72a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-30T01:55:30.111 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:30.109+0000 7fbbfd72a3c0 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-09-30T01:55:30.974 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-09-30T01:55:30.989 INFO:tasks.ceph:Reading keys from all nodes... 2023-09-30T01:55:30.990 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:30.990 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-09-30T01:55:31.007 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:31.007 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-09-30T01:55:31.065 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:31.065 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-09-30T01:55:31.075 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:31.075 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-09-30T01:55:31.090 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:31.090 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-09-30T01:55:31.107 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:31.107 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mgr/ceph-z/keyring of=/dev/stdout 2023-09-30T01:55:31.123 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:31.123 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-09-30T01:55:31.134 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:31.134 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-09-30T01:55:31.197 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:31.197 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-09-30T01:55:31.213 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:31.213 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-09-30T01:55:31.225 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:31.225 DEBUG:teuthology.orchestra.run.smithi055:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-09-30T01:55:31.231 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:31.231 DEBUG:teuthology.orchestra.run.smithi133:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-09-30T01:55:31.272 INFO:tasks.ceph:Adding keys to all mons... 2023-09-30T01:55:31.272 DEBUG:teuthology.orchestra.run.smithi055:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-30T01:55:31.274 DEBUG:teuthology.orchestra.run.smithi133:> sudo tee -a /etc/ceph/ceph.keyring 2023-09-30T01:55:31.287 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.x] 2023-09-30T01:55:31.287 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQACgBdlw/U4LRAAoNH3MCWoCZZgXnsTauI+PQ== 2023-09-30T01:55:31.287 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.a] 2023-09-30T01:55:31.287 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQACgBdlc9pxOBAAgy4mncqDeGc3Y4OWkHjwEg== 2023-09-30T01:55:31.287 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.c] 2023-09-30T01:55:31.287 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQADgBdlIOF4ABAATjTujHEO3MOTpe7El9o31g== 2023-09-30T01:55:31.287 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.0] 2023-09-30T01:55:31.287 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAEgBdlfx9fLxAA2boQ0zwSHiO434RYzTmmwg== 2023-09-30T01:55:31.288 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.y] 2023-09-30T01:55:31.288 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQACgBdlBaoWMBAAeM/vi+JshZNpL8y8L3GNeA== 2023-09-30T01:55:31.288 INFO:teuthology.orchestra.run.smithi055.stdout:[mgr.z] 2023-09-30T01:55:31.288 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQACgBdlavNlNRAA1tCU2bhKY8yxep9REOV8yQ== 2023-09-30T01:55:31.288 INFO:teuthology.orchestra.run.smithi055.stdout:[mds.b] 2023-09-30T01:55:31.288 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQADgBdl6aATBxAAsYcj3pKN7RDbB5XBaPD8og== 2023-09-30T01:55:31.288 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.1] 2023-09-30T01:55:31.288 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAJgBdlT1h1MRAAgfgMt1TNc9vrYCfruRGNDw== 2023-09-30T01:55:31.288 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.2] 2023-09-30T01:55:31.288 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAMgBdlRGLbNBAAQXrvhW5Ys59UL6fzCN6HEQ== 2023-09-30T01:55:31.289 INFO:teuthology.orchestra.run.smithi055.stdout:[osd.3] 2023-09-30T01:55:31.289 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQAPgBdlYETAOhAArpUbUGMbMbsKZNwe/ZC1mA== 2023-09-30T01:55:31.289 INFO:teuthology.orchestra.run.smithi055.stdout:[client.0] 2023-09-30T01:55:31.289 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQADgBdlDeQ2ChAASOVaMfdqwaANdVSVL15EeQ== 2023-09-30T01:55:31.289 INFO:teuthology.orchestra.run.smithi055.stdout:[client.1] 2023-09-30T01:55:31.289 INFO:teuthology.orchestra.run.smithi055.stdout: key = AQADgBdlU1klDRAA7xmxz0K5NvegT6q9cUyyWA== 2023-09-30T01:55:31.291 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.x] 2023-09-30T01:55:31.291 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQACgBdlw/U4LRAAoNH3MCWoCZZgXnsTauI+PQ== 2023-09-30T01:55:31.291 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.a] 2023-09-30T01:55:31.291 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQACgBdlc9pxOBAAgy4mncqDeGc3Y4OWkHjwEg== 2023-09-30T01:55:31.291 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.c] 2023-09-30T01:55:31.291 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQADgBdlIOF4ABAATjTujHEO3MOTpe7El9o31g== 2023-09-30T01:55:31.291 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.0] 2023-09-30T01:55:31.291 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAEgBdlfx9fLxAA2boQ0zwSHiO434RYzTmmwg== 2023-09-30T01:55:31.292 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.y] 2023-09-30T01:55:31.292 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQACgBdlBaoWMBAAeM/vi+JshZNpL8y8L3GNeA== 2023-09-30T01:55:31.292 INFO:teuthology.orchestra.run.smithi133.stdout:[mgr.z] 2023-09-30T01:55:31.292 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQACgBdlavNlNRAA1tCU2bhKY8yxep9REOV8yQ== 2023-09-30T01:55:31.292 INFO:teuthology.orchestra.run.smithi133.stdout:[mds.b] 2023-09-30T01:55:31.292 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQADgBdl6aATBxAAsYcj3pKN7RDbB5XBaPD8og== 2023-09-30T01:55:31.292 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.1] 2023-09-30T01:55:31.292 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAJgBdlT1h1MRAAgfgMt1TNc9vrYCfruRGNDw== 2023-09-30T01:55:31.292 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.2] 2023-09-30T01:55:31.293 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAMgBdlRGLbNBAAQXrvhW5Ys59UL6fzCN6HEQ== 2023-09-30T01:55:31.293 INFO:teuthology.orchestra.run.smithi133.stdout:[osd.3] 2023-09-30T01:55:31.293 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQAPgBdlYETAOhAArpUbUGMbMbsKZNwe/ZC1mA== 2023-09-30T01:55:31.293 INFO:teuthology.orchestra.run.smithi133.stdout:[client.0] 2023-09-30T01:55:31.293 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQADgBdlDeQ2ChAASOVaMfdqwaANdVSVL15EeQ== 2023-09-30T01:55:31.293 INFO:teuthology.orchestra.run.smithi133.stdout:[client.1] 2023-09-30T01:55:31.293 INFO:teuthology.orchestra.run.smithi133.stdout: key = AQADgBdlU1klDRAA7xmxz0K5NvegT6q9cUyyWA== 2023-09-30T01:55:31.293 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T01:55:31.296 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T01:55:31.338 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T01:55:31.341 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T01:55:31.429 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T01:55:31.432 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T01:55:31.478 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T01:55:31.480 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T01:55:31.519 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T01:55:31.522 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T01:55:31.606 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T01:55:31.608 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.z --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-09-30T01:55:31.652 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T01:55:31.654 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-09-30T01:55:31.741 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T01:55:31.744 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T01:55:31.788 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T01:55:31.791 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T01:55:31.832 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T01:55:31.834 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-09-30T01:55:31.919 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T01:55:31.922 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T01:55:31.972 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T01:55:31.974 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-09-30T01:55:32.019 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-09-30T01:55:32.019 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-09-30T01:55:32.032 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T01:55:32.099 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-09-30T01:55:32.113 DEBUG:teuthology.orchestra.run.smithi055:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-09-30T01:55:32.124 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T01:55:32.180 DEBUG:teuthology.orchestra.run.smithi055:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-09-30T01:55:32.194 DEBUG:teuthology.orchestra.run.smithi133:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-09-30T01:55:32.211 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-09-30T01:55:32.270 DEBUG:teuthology.orchestra.run.smithi133:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-09-30T01:55:32.283 DEBUG:teuthology.orchestra.run.smithi055:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-30T01:55:32.286 DEBUG:teuthology.orchestra.run.smithi133:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-09-30T01:55:32.291 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-09-30T01:55:32.291 INFO:tasks.ceph.mon.a:Restarting daemon 2023-09-30T01:55:32.292 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-09-30T01:55:32.294 INFO:tasks.ceph.mon.a:Started 2023-09-30T01:55:32.294 INFO:tasks.ceph.mon.c:Restarting daemon 2023-09-30T01:55:32.294 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-09-30T01:55:32.296 INFO:tasks.ceph.mon.c:Started 2023-09-30T01:55:32.296 INFO:tasks.ceph.mon.b:Restarting daemon 2023-09-30T01:55:32.297 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-09-30T01:55:32.336 INFO:tasks.ceph.mon.b:Started 2023-09-30T01:55:32.336 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-09-30T01:55:32.337 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-09-30T01:55:32.337 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-09-30T01:55:32.340 INFO:tasks.ceph.mgr.x:Started 2023-09-30T01:55:32.340 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-09-30T01:55:32.340 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-09-30T01:55:32.342 INFO:tasks.ceph.mgr.y:Started 2023-09-30T01:55:32.343 INFO:tasks.ceph.mgr.z:Restarting daemon 2023-09-30T01:55:32.343 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i z 2023-09-30T01:55:32.345 INFO:tasks.ceph.mgr.z:Started 2023-09-30T01:55:32.345 INFO:tasks.ceph:Setting crush tunables to default 2023-09-30T01:55:32.345 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd crush tunables default 2023-09-30T01:55:32.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92ee81700 1 Processor -- start 2023-09-30T01:55:32.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92ee81700 1 -- start start 2023-09-30T01:55:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92ee81700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92ee81700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc92813e350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92ee81700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 0x7fc92806cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92ee81700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92813f620 con 0x7fc92813ec50 2023-09-30T01:55:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92ee81700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92813f8e0 con 0x7fc9280a59a0 2023-09-30T01:55:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92ee81700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc92813fba0 con 0x7fc9280a55d0 2023-09-30T01:55:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92cc1d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92d41e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 0x7fc92806cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92cc1d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:46102/0 (socket says 172.21.15.55:46102) 2023-09-30T01:55:32.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 learned_addr learned my addr 172.21.15.55:0/2630975743 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 msgr2=0x7fc9280a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T01:55:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 msgr2=0x7fc9280a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.432+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.436+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T01:55:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.436+0000 7fc927fff700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc92813e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.436+0000 7fc92d41e700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 msgr2=0x7fc92806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T01:55:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.436+0000 7fc92d41e700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 msgr2=0x7fc92806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.436+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 0x7fc92806cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.436+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 0x7fc92806cc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T01:55:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.436+0000 7fc927fff700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 msgr2=0x7fc92813e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T01:55:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.436+0000 7fc927fff700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 msgr2=0x7fc92813e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:32.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.436+0000 7fc927fff700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc92813e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:32.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.436+0000 7fc927fff700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc92813e350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T01:55:32.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 0x7fc92806cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc92d41e700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 msgr2=0x7fc92806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T01:55:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc92d41e700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 msgr2=0x7fc92806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc927fff700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc92813e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 0x7fc92806cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 0x7fc92806cc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-30T01:55:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 msgr2=0x7fc9280a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T01:55:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 msgr2=0x7fc9280a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-30T01:55:32.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc927fff700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 msgr2=0x7fc92813e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T01:55:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc927fff700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 msgr2=0x7fc92813e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc927fff700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc92813e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:32.644 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:32.640+0000 7fc927fff700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc92813e350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-30T01:55:33.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 0x7fc92806cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:33.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:33.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc927fff700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc92813e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:33.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc92d41e700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 msgr2=0x7fc92806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T01:55:33.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc92d41e700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 msgr2=0x7fc92806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:33.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 0x7fc92806cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:33.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc927fff700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 msgr2=0x7fc92813e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T01:55:33.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc927fff700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 msgr2=0x7fc92813e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:33.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 msgr2=0x7fc9280a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T01:55:33.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 0x7fc92806cc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-30T01:55:33.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc927fff700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc92813e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:33.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 msgr2=0x7fc9280a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:33.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:33.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc927fff700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc92813e350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-30T01:55:33.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.044+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2023-09-30T01:55:33.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:33.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 0x7fc92806cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:33.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc927fff700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc92813e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:33.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 msgr2=0x7fc9280a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T01:55:33.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 msgr2=0x7fc9280a6cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:33.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc92d41e700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 msgr2=0x7fc92806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-09-30T01:55:33.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc92d41e700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 msgr2=0x7fc92806cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:33.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:33.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 0x7fc92806cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:33.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc927fff700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 msgr2=0x7fc92813e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T01:55:33.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 0x7fc92806cc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-30T01:55:33.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-30T01:55:33.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc927fff700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 msgr2=0x7fc92813e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:33.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc927fff700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc92813e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:33.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:33.848+0000 7fc927fff700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc92813e350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2023-09-30T01:55:35.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:35.436+0000 7fc9267fc700 1 -- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 msgr2=0x7fc9280a6cf0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T01:55:35.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:35.436+0000 7fc9267fc700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9280a55d0 0x7fc9280a6cf0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:35.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:35.436+0000 7fc9267fc700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 msgr2=0x7fc92813e350 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T01:55:35.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:35.436+0000 7fc9267fc700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc92813e350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:35.436+0000 7fc9267fc700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 msgr2=0x7fc92806cc30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T01:55:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:35.436+0000 7fc9267fc700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc92813ec50 0x7fc92806cc30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:35.436+0000 7fc9267fc700 1 -- 172.21.15.55:0/2630975743 --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc92813f060 con 0x7fc9100036e0 2023-09-30T01:55:35.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:35.436+0000 7fc9267fc700 1 -- 172.21.15.55:0/2630975743 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91000c0a0 con 0x7fc910007340 2023-09-30T01:55:38.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc9267fc700 1 -- 172.21.15.55:0/2630975743 >> v1:172.21.15.133:6789/0 conn(0x7fc910007340 legacy=0x7fc9100097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:38.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc9267fc700 1 -- 172.21.15.55:0/2630975743 >> v1:172.21.15.55:6789/0 conn(0x7fc9100036e0 legacy=0x7fc910005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:38.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc92d41e700 1 -- 172.21.15.55:0/2630975743 reap_dead start 2023-09-30T01:55:38.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc9267fc700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc91000c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:38.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc9267fc700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc91000cde0 0x7fc9100097f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:38.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc9267fc700 1 -- 172.21.15.55:0/2630975743 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91000d2a0 con 0x7fc91000c940 2023-09-30T01:55:38.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc9267fc700 1 -- 172.21.15.55:0/2630975743 --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92813f620 con 0x7fc91000cde0 2023-09-30T01:55:38.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc9267fc700 1 -- 172.21.15.55:0/2630975743 --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc92813f8e0 con 0x7fc9280a59a0 2023-09-30T01:55:38.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc91000cde0 0x7fc9100097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:38.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc91000c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:38.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc92d41e700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc91000cde0 msgr2=0x7fc9100097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T01:55:38.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc92d41e700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc91000cde0 msgr2=0x7fc9100097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:38.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc91000cde0 0x7fc9100097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:38.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 msgr2=0x7fc91000c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T01:55:38.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 msgr2=0x7fc91000c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:38.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc91000cde0 0x7fc9100097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T01:55:38.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc91000c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:38.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.436+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc91000c3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-09-30T01:55:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.640+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc91000cde0 0x7fc9100097f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.640+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc91000c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.640+0000 7fc92d41e700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc91000cde0 msgr2=0x7fc9100097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-09-30T01:55:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.640+0000 7fc92d41e700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc91000cde0 msgr2=0x7fc9100097f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:38.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.640+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc91000cde0 0x7fc9100097f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.640+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc91000cde0 0x7fc9100097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-30T01:55:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.640+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 msgr2=0x7fc91000c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-09-30T01:55:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.640+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 msgr2=0x7fc91000c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-09-30T01:55:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.640+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc91000c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-09-30T01:55:38.643 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.640+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc91000c3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-09-30T01:55:38.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.724+0000 7fc9277fe700 1 -- 172.21.15.55:0/2630975743 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4079100577 0 0) 0x7fc91000d2a0 con 0x7fc91000c940 2023-09-30T01:55:38.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.724+0000 7fc9277fe700 1 -- 172.21.15.55:0/2630975743 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc914003570 con 0x7fc91000c940 2023-09-30T01:55:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc9277fe700 1 -- 172.21.15.55:0/2630975743 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2763880434 0 0) 0x7fc914003570 con 0x7fc91000c940 2023-09-30T01:55:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc9277fe700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 msgr2=0x7fc91000c3e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T01:55:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc9277fe700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.133:3300/0 conn(0x7fc9280a59a0 0x7fc91000c3e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc9277fe700 1 -- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc91000cde0 msgr2=0x7fc9100097f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-09-30T01:55:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc9277fe700 1 --2- 172.21.15.55:0/2630975743 >> v2:172.21.15.55:3300/0 conn(0x7fc91000cde0 0x7fc9100097f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc9277fe700 1 -- 172.21.15.55:0/2630975743 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc910006240 con 0x7fc91000c940 2023-09-30T01:55:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc9277fe700 1 -- 172.21.15.55:0/2630975743 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 254224620 0 0) 0x7fc91c00d300 con 0x7fc91000c940 2023-09-30T01:55:38.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc9277fe700 1 -- 172.21.15.55:0/2630975743 >> v1:172.21.15.133:6789/0 conn(0x7fc91000c940 legacy=0x7fc910005b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:38.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc9277fe700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc914003a90 0x7fc914003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:38.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc9277fe700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc914004810 0x7fc914004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:38.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc9277fe700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9140051c0 0x7fc91400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:38.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc9277fe700 1 -- 172.21.15.55:0/2630975743 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92813f620 con 0x7fc914004810 2023-09-30T01:55:38.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc9277fe700 1 -- 172.21.15.55:0/2630975743 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc92813f8e0 con 0x7fc9140051c0 2023-09-30T01:55:38.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc9277fe700 1 -- 172.21.15.55:0/2630975743 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91400c1e0 con 0x7fc914003a90 2023-09-30T01:55:38.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc914003a90 0x7fc914003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:38.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc927fff700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc914004810 0x7fc914004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:38.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9140051c0 0x7fc91400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:38.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9140051c0 msgr2=0x7fc91400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:38.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9140051c0 0x7fc91400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:38.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc914004810 msgr2=0x7fc914004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:38.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc914004810 0x7fc914004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:38.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc92cc1d700 1 -- 172.21.15.55:0/2630975743 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc914003570 con 0x7fc914003a90 2023-09-30T01:55:38.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc92d41e700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9140051c0 0x7fc91400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:55:38.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc927fff700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc914004810 0x7fc914004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:55:38.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.728+0000 7fc92d41e700 1 -- 172.21.15.55:0/2630975743 reap_dead start 2023-09-30T01:55:38.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.732+0000 7fc92cc1d700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc914003a90 0x7fc914003ea0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc920009450 tx=0x7fc920009040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a13125e53e9bd5ba server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:38.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.732+0000 7fc9277fe700 1 -- 172.21.15.55:0/2630975743 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920009890 con 0x7fc914003a90 2023-09-30T01:55:38.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.732+0000 7fc9277fe700 1 -- 172.21.15.55:0/2630975743 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc92000f040 con 0x7fc914003a90 2023-09-30T01:55:38.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.732+0000 7fc9277fe700 1 -- 172.21.15.55:0/2630975743 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc920007d70 con 0x7fc914003a90 2023-09-30T01:55:38.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 -- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc914003a90 msgr2=0x7fc914003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:38.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc914003a90 0x7fc914003ea0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fc920009450 tx=0x7fc920009040 comp rx=0 tx=0).stop 2023-09-30T01:55:38.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 -- 172.21.15.55:0/2630975743 shutdown_connections 2023-09-30T01:55:38.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 --2- 172.21.15.55:0/2630975743 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc914003a90 0x7fc914003ea0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:38.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 -- 172.21.15.55:0/2630975743 >> 172.21.15.55:0/2630975743 conn(0x7fc9280689e0 msgr2=0x7fc9280b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:38.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 -- 172.21.15.55:0/2630975743 shutdown_connections 2023-09-30T01:55:38.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 -- 172.21.15.55:0/2630975743 wait complete. 2023-09-30T01:55:38.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 Processor -- start 2023-09-30T01:55:38.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 -- start start 2023-09-30T01:55:38.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc914003a90 0x7fc9281425d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:38.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92806ca70 0x7fc92806ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:38.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc928132260 0x7fc9281326b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:38.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc928141b30 con 0x7fc914003a90 2023-09-30T01:55:38.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc928127240 con 0x7fc92806ca70 2023-09-30T01:55:38.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92ee81700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc928131fa0 con 0x7fc928132260 2023-09-30T01:55:38.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92cc1d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc914003a90 0x7fc9281425d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:38.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc927fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92806ca70 0x7fc92806ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:38.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc927fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92806ca70 0x7fc92806ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.55:51030/0 (socket says 172.21.15.55:51030) 2023-09-30T01:55:38.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92cc1d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc914003a90 0x7fc9281425d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49400/0 (socket says 172.21.15.55:49400) 2023-09-30T01:55:38.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc927fff700 1 -- 172.21.15.55:0/1428448983 learned_addr learned my addr 172.21.15.55:0/1428448983 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:38.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.736+0000 7fc92d41e700 1 --2- 172.21.15.55:0/1428448983 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc928132260 0x7fc9281326b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:38.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc927fff700 1 -- 172.21.15.55:0/1428448983 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc928132260 msgr2=0x7fc9281326b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:38.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc927fff700 1 --2- 172.21.15.55:0/1428448983 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc928132260 0x7fc9281326b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:38.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc927fff700 1 -- 172.21.15.55:0/1428448983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc914003a90 msgr2=0x7fc9281425d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:38.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc927fff700 1 --2- 172.21.15.55:0/1428448983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc914003a90 0x7fc9281425d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:38.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc927fff700 1 -- 172.21.15.55:0/1428448983 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92806d380 con 0x7fc92806ca70 2023-09-30T01:55:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc927fff700 1 --2- 172.21.15.55:0/1428448983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92806ca70 0x7fc92806ce40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00d430 tx=0x7fc91c008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc924ff9700 1 -- 172.21.15.55:0/1428448983 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c014940 con 0x7fc92806ca70 2023-09-30T01:55:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc924ff9700 1 -- 172.21.15.55:0/1428448983 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91c01b070 con 0x7fc92806ca70 2023-09-30T01:55:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc92ee81700 1 -- 172.21.15.55:0/1428448983 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9281336d0 con 0x7fc92806ca70 2023-09-30T01:55:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc924ff9700 1 -- 172.21.15.55:0/1428448983 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91c014cf0 con 0x7fc92806ca70 2023-09-30T01:55:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc92ee81700 1 -- 172.21.15.55:0/1428448983 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc928142b10 con 0x7fc92806ca70 2023-09-30T01:55:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc924ff9700 1 -- 172.21.15.55:0/1428448983 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc91c01d030 con 0x7fc92806ca70 2023-09-30T01:55:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc924ff9700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-09-30T01:55:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc924ff9700 4 mgrc handle_mgr_map Got map version 1 2023-09-30T01:55:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc924ff9700 4 mgrc handle_mgr_map Active mgr is now 2023-09-30T01:55:38.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc924ff9700 4 mgrc reconnect No active mgr available yet 2023-09-30T01:55:38.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc924ff9700 1 -- 172.21.15.55:0/1428448983 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc91c02a440 con 0x7fc92806ca70 2023-09-30T01:55:38.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.740+0000 7fc92ee81700 1 -- 172.21.15.55:0/1428448983 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc928142d00 con 0x7fc92806ca70 2023-09-30T01:55:38.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.744+0000 7fc924ff9700 1 -- 172.21.15.55:0/1428448983 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc91c017650 con 0x7fc92806ca70 2023-09-30T01:55:38.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.816+0000 7fc92ee81700 1 -- 172.21.15.55:0/1428448983 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7fc928142d00 con 0x7fc92806ca70 2023-09-30T01:55:38.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.824+0000 7fc924ff9700 1 -- 172.21.15.55:0/1428448983 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7fc91c02a600 con 0x7fc92806ca70 2023-09-30T01:55:38.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.828+0000 7fc92ee81700 10 mgrc shutdown 2023-09-30T01:55:38.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.828+0000 7fc92ee81700 1 -- 172.21.15.55:0/1428448983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92806ca70 msgr2=0x7fc92806ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:38.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.828+0000 7fc92ee81700 1 --2- 172.21.15.55:0/1428448983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92806ca70 0x7fc92806ce40 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fc91c00d430 tx=0x7fc91c008040 comp rx=0 tx=0).stop 2023-09-30T01:55:38.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.828+0000 7fc92ee81700 1 -- 172.21.15.55:0/1428448983 shutdown_connections 2023-09-30T01:55:38.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.828+0000 7fc92ee81700 1 --2- 172.21.15.55:0/1428448983 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc928132260 0x7fc9281326b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:38.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.828+0000 7fc92ee81700 1 --2- 172.21.15.55:0/1428448983 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc92806ca70 0x7fc92806ce40 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:38.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.828+0000 7fc92ee81700 1 --2- 172.21.15.55:0/1428448983 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc914003a90 0x7fc9281425d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:38.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.828+0000 7fc92ee81700 1 -- 172.21.15.55:0/1428448983 >> 172.21.15.55:0/1428448983 conn(0x7fc9280689e0 msgr2=0x7fc9280b0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:38.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.828+0000 7fc92ee81700 1 -- 172.21.15.55:0/1428448983 shutdown_connections 2023-09-30T01:55:38.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:38.828+0000 7fc92ee81700 1 -- 172.21.15.55:0/1428448983 wait complete. 2023-09-30T01:55:38.831 INFO:teuthology.orchestra.run.smithi055.stderr:adjusted tunables profile to default 2023-09-30T01:55:38.843 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-09-30T01:55:38.844 DEBUG:teuthology.orchestra.run.smithi055:> set -ex 2023-09-30T01:55:38.844 DEBUG:teuthology.orchestra.run.smithi055:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-09-30T01:55:38.854 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:38.854 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-09-30T01:55:38.870 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:38.870 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-09-30T01:55:38.907 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:38.904+0000 7f557d9d6000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T01:55:38.924 DEBUG:teuthology.orchestra.run.smithi133:> set -ex 2023-09-30T01:55:38.924 DEBUG:teuthology.orchestra.run.smithi133:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-09-30T01:55:38.937 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19 0 2023-09-30T01:55:38.943 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:38.941+0000 7fef20330000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T01:55:38.947 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:38.945+0000 7f0dd8946000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-09-30T01:55:39.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7129f4a700 1 Processor -- start 2023-09-30T01:55:39.034 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7129f4a700 1 -- start start 2023-09-30T01:55:39.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7129f4a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7124069a10 0x7f71240a7630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7129f4a700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71241422c0 con 0x7f7124141a80 2023-09-30T01:55:39.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7129f4a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7124069de0 con 0x7f7124133da0 2023-09-30T01:55:39.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7129f4a700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7124142000 con 0x7f7124069a10 2023-09-30T01:55:39.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7123fff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f7124133da0 0x7f7124141370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48018/0 (socket says 172.21.15.133:48018) 2023-09-30T01:55:39.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7123fff700 1 -- 172.21.15.133:0/2485653045 learned_addr learned my addr 172.21.15.133:0/2485653045 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-09-30T01:55:39.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7128f48700 1 --2- 172.21.15.133:0/2485653045 >> v2:172.21.15.55:3300/0 conn(0x7f7124069a10 0x7f71240a7630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.037 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 -- 172.21.15.133:0/2485653045 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2213240260 0 0) 0x7f7124069de0 con 0x7f7124133da0 2023-09-30T01:55:39.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 -- 172.21.15.133:0/2485653045 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7114003570 con 0x7f7124133da0 2023-09-30T01:55:39.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 -- 172.21.15.133:0/2485653045 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1421797670 0 0) 0x7f7114003570 con 0x7f7124133da0 2023-09-30T01:55:39.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 -- 172.21.15.133:0/2485653045 >> v2:172.21.15.55:3300/0 conn(0x7f7124069a10 msgr2=0x7f71240a7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:39.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 --2- 172.21.15.133:0/2485653045 >> v2:172.21.15.55:3300/0 conn(0x7f7124069a10 0x7f71240a7630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 -- 172.21.15.133:0/2485653045 >> v1:172.21.15.55:6789/0 conn(0x7f7124141a80 legacy=0x7f7124148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 -- 172.21.15.133:0/2485653045 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71240a5d60 con 0x7f7124133da0 2023-09-30T01:55:39.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 -- 172.21.15.133:0/2485653045 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 254224620 0 0) 0x7f7110001470 con 0x7f7124133da0 2023-09-30T01:55:39.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 -- 172.21.15.133:0/2485653045 >> v1:172.21.15.133:6789/0 conn(0x7f7124133da0 legacy=0x7f7124141370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 --2- 172.21.15.133:0/2485653045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003a60 0x7f7114003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 --2- 172.21.15.133:0/2485653045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7114004810 0x7f7114004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 --2- 172.21.15.133:0/2485653045 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f71140051c0 0x7f711400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.038 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 -- 172.21.15.133:0/2485653045 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7124142000 con 0x7f7114004810 2023-09-30T01:55:39.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 -- 172.21.15.133:0/2485653045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f711400c0d0 con 0x7f7114003a60 2023-09-30T01:55:39.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 -- 172.21.15.133:0/2485653045 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f711400c290 con 0x7f71140051c0 2023-09-30T01:55:39.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7128f48700 1 --2- 172.21.15.133:0/2485653045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003a60 0x7f7114003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7123fff700 1 --2- 172.21.15.133:0/2485653045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7114004810 0x7f7114004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7129749700 1 --2- 172.21.15.133:0/2485653045 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f71140051c0 0x7f711400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7128f48700 1 -- 172.21.15.133:0/2485653045 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f71140051c0 msgr2=0x7f711400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:39.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7128f48700 1 --2- 172.21.15.133:0/2485653045 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f71140051c0 0x7f711400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7128f48700 1 -- 172.21.15.133:0/2485653045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7114004810 msgr2=0x7f7114004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:39.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7128f48700 1 --2- 172.21.15.133:0/2485653045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7114004810 0x7f7114004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7128f48700 1 -- 172.21.15.133:0/2485653045 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7114003570 con 0x7f7114003a60 2023-09-30T01:55:39.039 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7129749700 1 -- 172.21.15.133:0/2485653045 reap_dead start 2023-09-30T01:55:39.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7123fff700 1 --2- 172.21.15.133:0/2485653045 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7114004810 0x7f7114004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:55:39.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f7128f48700 1 --2- 172.21.15.133:0/2485653045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003a60 0x7f7114003e70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7118009c00 tx=0x7f71180091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1dc265f99460c872 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:39.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 -- 172.21.15.133:0/2485653045 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711800e710 con 0x7f7114003a60 2023-09-30T01:55:39.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 -- 172.21.15.133:0/2485653045 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711800e870 con 0x7f7114003a60 2023-09-30T01:55:39.040 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.033+0000 7f71237fe700 1 -- 172.21.15.133:0/2485653045 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711800ec30 con 0x7f7114003a60 2023-09-30T01:55:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 -- 172.21.15.133:0/2485653045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003a60 msgr2=0x7f7114003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 --2- 172.21.15.133:0/2485653045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003a60 0x7f7114003e70 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f7118009c00 tx=0x7f71180091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 -- 172.21.15.133:0/2485653045 shutdown_connections 2023-09-30T01:55:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 --2- 172.21.15.133:0/2485653045 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7114003a60 0x7f7114003e70 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 -- 172.21.15.133:0/2485653045 >> 172.21.15.133:0/2485653045 conn(0x7f71240b2b10 msgr2=0x7f71240b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:39.043 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 -- 172.21.15.133:0/2485653045 shutdown_connections 2023-09-30T01:55:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 -- 172.21.15.133:0/2485653045 wait complete. 2023-09-30T01:55:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 Processor -- start 2023-09-30T01:55:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 -- start start 2023-09-30T01:55:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7114003a60 0x7f71240aee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7124144000 0x7f71240a99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71240a9ef0 0x7f71240ad310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71240af6d0 con 0x7f7114003a60 2023-09-30T01:55:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71240aa4f0 con 0x7f71240a9ef0 2023-09-30T01:55:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129f4a700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71240aa7b0 con 0x7f7124144000 2023-09-30T01:55:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129749700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71240a9ef0 0x7f71240ad310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129749700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71240a9ef0 0x7f71240ad310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33884/0 (socket says 172.21.15.133:33884) 2023-09-30T01:55:39.044 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129749700 1 -- 172.21.15.133:0/3528429820 learned_addr learned my addr 172.21.15.133:0/3528429820 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-09-30T01:55:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7128f48700 1 --2- 172.21.15.133:0/3528429820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7114003a60 0x7f71240aee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7123fff700 1 --2- 172.21.15.133:0/3528429820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7124144000 0x7f71240a99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129749700 1 -- 172.21.15.133:0/3528429820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7124144000 msgr2=0x7f71240a99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129749700 1 --2- 172.21.15.133:0/3528429820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7124144000 0x7f71240a99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129749700 1 -- 172.21.15.133:0/3528429820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7114003a60 msgr2=0x7f71240aee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129749700 1 --2- 172.21.15.133:0/3528429820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7114003a60 0x7f71240aee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129749700 1 -- 172.21.15.133:0/3528429820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71240ab630 con 0x7f71240a9ef0 2023-09-30T01:55:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.037+0000 7f7129749700 1 --2- 172.21.15.133:0/3528429820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71240a9ef0 0x7f71240ad310 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7124068f50 tx=0x7f711c001640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.041+0000 7f7120ff9700 1 -- 172.21.15.133:0/3528429820 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c006e80 con 0x7f71240a9ef0 2023-09-30T01:55:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.041+0000 7f7120ff9700 1 -- 172.21.15.133:0/3528429820 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f711c00c5d0 con 0x7f71240a9ef0 2023-09-30T01:55:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.041+0000 7f7129f4a700 1 -- 172.21.15.133:0/3528429820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71240ab7c0 con 0x7f71240a9ef0 2023-09-30T01:55:39.045 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.041+0000 7f7120ff9700 1 -- 172.21.15.133:0/3528429820 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f711c00c990 con 0x7f71240a9ef0 2023-09-30T01:55:39.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.041+0000 7f7129f4a700 1 -- 172.21.15.133:0/3528429820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71240ad9f0 con 0x7f71240a9ef0 2023-09-30T01:55:39.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.041+0000 7f7120ff9700 1 -- 172.21.15.133:0/3528429820 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f711c014480 con 0x7f71240a9ef0 2023-09-30T01:55:39.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.041+0000 7f7120ff9700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-09-30T01:55:39.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.041+0000 7f7120ff9700 4 mgrc handle_mgr_map Got map version 1 2023-09-30T01:55:39.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.041+0000 7f7120ff9700 4 mgrc handle_mgr_map Active mgr is now 2023-09-30T01:55:39.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.041+0000 7f7120ff9700 4 mgrc reconnect No active mgr available yet 2023-09-30T01:55:39.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.041+0000 7f7120ff9700 1 -- 172.21.15.133:0/3528429820 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7f711c01e790 con 0x7f71240a9ef0 2023-09-30T01:55:39.046 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.041+0000 7f7129f4a700 1 -- 172.21.15.133:0/3528429820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7124064440 con 0x7f71240a9ef0 2023-09-30T01:55:39.047 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.045+0000 7f7120ff9700 1 -- 172.21.15.133:0/3528429820 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f711c019070 con 0x7f71240a9ef0 2023-09-30T01:55:39.120 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.117+0000 7f7129f4a700 1 -- 172.21.15.133:0/3528429820 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19", "id": 0} v 0) v1 -- 0x7f71240af430 con 0x7f71240a9ef0 2023-09-30T01:55:39.131 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.129+0000 7f7120ff9700 1 -- 172.21.15.133:0/3528429820 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f711c014870 con 0x7f71240a9ef0 2023-09-30T01:55:39.131 INFO:teuthology.orchestra.run.smithi133.stdout:0 2023-09-30T01:55:39.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.129+0000 7f7129f4a700 10 mgrc shutdown 2023-09-30T01:55:39.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.129+0000 7f7129f4a700 1 -- 172.21.15.133:0/3528429820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71240a9ef0 msgr2=0x7f71240ad310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.132 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.129+0000 7f7129f4a700 1 --2- 172.21.15.133:0/3528429820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71240a9ef0 0x7f71240ad310 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f7124068f50 tx=0x7f711c001640 comp rx=0 tx=0).stop 2023-09-30T01:55:39.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.129+0000 7f7129f4a700 1 -- 172.21.15.133:0/3528429820 shutdown_connections 2023-09-30T01:55:39.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.129+0000 7f7129f4a700 1 --2- 172.21.15.133:0/3528429820 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f71240a9ef0 0x7f71240ad310 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.129+0000 7f7129f4a700 1 --2- 172.21.15.133:0/3528429820 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7124144000 0x7f71240a99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.129+0000 7f7129f4a700 1 --2- 172.21.15.133:0/3528429820 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7114003a60 0x7f71240aee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.129+0000 7f7129f4a700 1 -- 172.21.15.133:0/3528429820 >> 172.21.15.133:0/3528429820 conn(0x7f71240b2b10 msgr2=0x7f712406d460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:39.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.129+0000 7f7129f4a700 1 -- 172.21.15.133:0/3528429820 shutdown_connections 2023-09-30T01:55:39.133 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.129+0000 7f7129f4a700 1 -- 172.21.15.133:0/3528429820 wait complete. 2023-09-30T01:55:39.145 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new b52b4f6f-00aa-4ef8-b3d4-467475cd0bac 1 2023-09-30T01:55:39.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.293+0000 7f327500a700 1 Processor -- start 2023-09-30T01:55:39.296 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.293+0000 7f327500a700 1 -- start start 2023-09-30T01:55:39.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.293+0000 7f327500a700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3270141a80 0x7f32701341c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.293+0000 7f327500a700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32701422c0 con 0x7f3270133da0 2023-09-30T01:55:39.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.293+0000 7f327500a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3270069de0 con 0x7f3270069a10 2023-09-30T01:55:39.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.293+0000 7f327500a700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3270134700 con 0x7f3270141a80 2023-09-30T01:55:39.298 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.293+0000 7f326ffff700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7f3270069a10 0x7f32700a7630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48020/0 (socket says 172.21.15.133:48020) 2023-09-30T01:55:39.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.293+0000 7f326ffff700 1 -- 172.21.15.133:0/1836577759 learned_addr learned my addr 172.21.15.133:0/1836577759 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-09-30T01:55:39.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.293+0000 7f3274809700 1 --2- 172.21.15.133:0/1836577759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3270141a80 0x7f32701341c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.293+0000 7f326f7fe700 1 -- 172.21.15.133:0/1836577759 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 53541608 0 0) 0x7f3270069de0 con 0x7f3270069a10 2023-09-30T01:55:39.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.293+0000 7f326f7fe700 1 -- 172.21.15.133:0/1836577759 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f325c003570 con 0x7f3270069a10 2023-09-30T01:55:39.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f3274809700 1 -- 172.21.15.133:0/1836577759 >> v1:172.21.15.133:6789/0 conn(0x7f3270069a10 legacy=0x7f32700a7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f326f7fe700 1 -- 172.21.15.133:0/1836577759 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2715049480 0 0) 0x7f325c003570 con 0x7f3270069a10 2023-09-30T01:55:39.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f3274809700 1 -- 172.21.15.133:0/1836577759 >> v1:172.21.15.55:6789/0 conn(0x7f3270133da0 legacy=0x7f3270141370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f3274809700 1 -- 172.21.15.133:0/1836577759 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32700a7d40 con 0x7f3270141a80 2023-09-30T01:55:39.299 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f3274809700 1 --2- 172.21.15.133:0/1836577759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3270141a80 0x7f32701341c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3268009e10 tx=0x7f3268009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10025726d3467859 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:39.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f326f7fe700 1 -- 172.21.15.133:0/1836577759 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f326800e070 con 0x7f3270141a80 2023-09-30T01:55:39.300 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f326f7fe700 1 -- 172.21.15.133:0/1836577759 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f326800b8d0 con 0x7f3270141a80 2023-09-30T01:55:39.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f326f7fe700 1 -- 172.21.15.133:0/1836577759 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260001470 con 0x7f3270141a80 2023-09-30T01:55:39.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f327500a700 1 -- 172.21.15.133:0/1836577759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3270141a80 msgr2=0x7f32701341c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f327500a700 1 --2- 172.21.15.133:0/1836577759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3270141a80 0x7f32701341c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3268009e10 tx=0x7f3268009780 comp rx=0 tx=0).stop 2023-09-30T01:55:39.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f327500a700 1 -- 172.21.15.133:0/1836577759 shutdown_connections 2023-09-30T01:55:39.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f327500a700 1 --2- 172.21.15.133:0/1836577759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3270141a80 0x7f32701341c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f327500a700 1 -- 172.21.15.133:0/1836577759 >> 172.21.15.133:0/1836577759 conn(0x7f32700b2b10 msgr2=0x7f32700b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:39.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f327500a700 1 -- 172.21.15.133:0/1836577759 shutdown_connections 2023-09-30T01:55:39.301 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f327500a700 1 -- 172.21.15.133:0/1836577759 wait complete. 2023-09-30T01:55:39.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f327500a700 1 Processor -- start 2023-09-30T01:55:39.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.297+0000 7f327500a700 1 -- start start 2023-09-30T01:55:39.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f327500a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3270069a10 0x7f3270147b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f327500a700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3270133da0 0x7f327006c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f327500a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3270141a80 0x7f327006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f327500a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327006ce30 con 0x7f3270141a80 2023-09-30T01:55:39.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f327500a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f327006b480 con 0x7f3270069a10 2023-09-30T01:55:39.304 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f327500a700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f327006b2d0 con 0x7f3270133da0 2023-09-30T01:55:39.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3270069a10 0x7f3270147b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3270069a10 0x7f3270147b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33890/0 (socket says 172.21.15.133:33890) 2023-09-30T01:55:39.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326ffff700 1 -- 172.21.15.133:0/1175533577 learned_addr learned my addr 172.21.15.133:0/1175533577 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-09-30T01:55:39.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f3267fff700 1 --2- 172.21.15.133:0/1175533577 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3270133da0 0x7f327006c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f3274809700 1 --2- 172.21.15.133:0/1175533577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3270141a80 0x7f327006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326ffff700 1 -- 172.21.15.133:0/1175533577 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3270133da0 msgr2=0x7f327006c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326ffff700 1 --2- 172.21.15.133:0/1175533577 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3270133da0 0x7f327006c3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326ffff700 1 -- 172.21.15.133:0/1175533577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3270141a80 msgr2=0x7f327006c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326ffff700 1 --2- 172.21.15.133:0/1175533577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3270141a80 0x7f327006c8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.305 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326ffff700 1 -- 172.21.15.133:0/1175533577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3268009a20 con 0x7f3270069a10 2023-09-30T01:55:39.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f3274809700 1 --2- 172.21.15.133:0/1175533577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3270141a80 0x7f327006c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:55:39.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326ffff700 1 --2- 172.21.15.133:0/1175533577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3270069a10 0x7f3270147b70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f326000cb90 tx=0x7f3260001aa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:39.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326cff9700 1 -- 172.21.15.133:0/1175533577 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260001d10 con 0x7f3270069a10 2023-09-30T01:55:39.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326cff9700 1 -- 172.21.15.133:0/1175533577 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3260007360 con 0x7f3270069a10 2023-09-30T01:55:39.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326cff9700 1 -- 172.21.15.133:0/1175533577 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3260004830 con 0x7f3270069a10 2023-09-30T01:55:39.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f327500a700 1 -- 172.21.15.133:0/1175533577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f327012b980 con 0x7f3270069a10 2023-09-30T01:55:39.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f327500a700 1 -- 172.21.15.133:0/1175533577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f327012c8c0 con 0x7f3270069a10 2023-09-30T01:55:39.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326cff9700 1 -- 172.21.15.133:0/1175533577 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f326000a570 con 0x7f3270069a10 2023-09-30T01:55:39.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326cff9700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-09-30T01:55:39.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326cff9700 4 mgrc handle_mgr_map Got map version 1 2023-09-30T01:55:39.306 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326cff9700 4 mgrc handle_mgr_map Active mgr is now 2023-09-30T01:55:39.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326cff9700 4 mgrc reconnect No active mgr available yet 2023-09-30T01:55:39.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f326cff9700 1 -- 172.21.15.133:0/1175533577 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f32600127c0 con 0x7f3270069a10 2023-09-30T01:55:39.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.301+0000 7f327500a700 1 -- 172.21.15.133:0/1175533577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3270064440 con 0x7f3270069a10 2023-09-30T01:55:39.307 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.305+0000 7f326cff9700 1 -- 172.21.15.133:0/1175533577 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3260018070 con 0x7f3270069a10 2023-09-30T01:55:39.382 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.381+0000 7f327500a700 1 -- 172.21.15.133:0/1175533577 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "b52b4f6f-00aa-4ef8-b3d4-467475cd0bac", "id": 1} v 0) v1 -- 0x7f32700a82e0 con 0x7f3270069a10 2023-09-30T01:55:39.393 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.389+0000 7f326cff9700 1 -- 172.21.15.133:0/1175533577 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b52b4f6f-00aa-4ef8-b3d4-467475cd0bac", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f326000a9b0 con 0x7f3270069a10 2023-09-30T01:55:39.393 INFO:teuthology.orchestra.run.smithi133.stdout:1 2023-09-30T01:55:39.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.393+0000 7f327500a700 10 mgrc shutdown 2023-09-30T01:55:39.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.393+0000 7f327500a700 1 -- 172.21.15.133:0/1175533577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3270069a10 msgr2=0x7f3270147b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.393+0000 7f327500a700 1 --2- 172.21.15.133:0/1175533577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3270069a10 0x7f3270147b70 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f326000cb90 tx=0x7f3260001aa0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.393+0000 7f327500a700 1 -- 172.21.15.133:0/1175533577 shutdown_connections 2023-09-30T01:55:39.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.393+0000 7f327500a700 1 --2- 172.21.15.133:0/1175533577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3270141a80 0x7f327006c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.393+0000 7f327500a700 1 --2- 172.21.15.133:0/1175533577 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3270133da0 0x7f327006c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.393+0000 7f327500a700 1 --2- 172.21.15.133:0/1175533577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3270069a10 0x7f3270147b70 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.395 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.393+0000 7f327500a700 1 -- 172.21.15.133:0/1175533577 >> 172.21.15.133:0/1175533577 conn(0x7f32700b2b10 msgr2=0x7f3270132a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:39.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.393+0000 7f327500a700 1 -- 172.21.15.133:0/1175533577 shutdown_connections 2023-09-30T01:55:39.396 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.393+0000 7f327500a700 1 -- 172.21.15.133:0/1175533577 wait complete. 2023-09-30T01:55:39.407 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new c48b2c87-a33c-47fc-8b84-e64faad378b0 2 2023-09-30T01:55:39.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.505+0000 7fc3de732700 1 Processor -- start 2023-09-30T01:55:39.509 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.505+0000 7fc3de732700 1 -- start start 2023-09-30T01:55:39.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3de732700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc3d80b38e0 0x7fc3d813fef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.512 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3de732700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d80a4100 con 0x7fc3d80b0ac0 2023-09-30T01:55:39.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3de732700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3d80b3cb0 con 0x7fc3d80a5ba0 2023-09-30T01:55:39.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3de732700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3d8140430 con 0x7fc3d80b38e0 2023-09-30T01:55:39.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3ddf31700 1 --1- >> v1:172.21.15.133:6789/0 conn(0x7fc3d80a5ba0 0x7fc3d814a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.133:48026/0 (socket says 172.21.15.133:48026) 2023-09-30T01:55:39.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3ddf31700 1 -- 172.21.15.133:0/4170877137 learned_addr learned my addr 172.21.15.133:0/4170877137 (peer_addr_for_me v1:172.21.15.133:0/0) 2023-09-30T01:55:39.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3dd730700 1 --2- 172.21.15.133:0/4170877137 >> v2:172.21.15.55:3300/0 conn(0x7fc3d80b38e0 0x7fc3d813fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 -- 172.21.15.133:0/4170877137 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4014320586 0 0) 0x7fc3d80b3cb0 con 0x7fc3d80a5ba0 2023-09-30T01:55:39.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 -- 172.21.15.133:0/4170877137 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3c4003570 con 0x7fc3d80a5ba0 2023-09-30T01:55:39.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 -- 172.21.15.133:0/4170877137 <== mon.1 v1:172.21.15.133:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3558264361 0 0) 0x7fc3c4003570 con 0x7fc3d80a5ba0 2023-09-30T01:55:39.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 -- 172.21.15.133:0/4170877137 >> v2:172.21.15.55:3300/0 conn(0x7fc3d80b38e0 msgr2=0x7fc3d813fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:39.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 --2- 172.21.15.133:0/4170877137 >> v2:172.21.15.55:3300/0 conn(0x7fc3d80b38e0 0x7fc3d813fef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.513 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 -- 172.21.15.133:0/4170877137 >> v1:172.21.15.55:6789/0 conn(0x7fc3d80b0ac0 legacy=0x7fc3d80a1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 -- 172.21.15.133:0/4170877137 --> v1:172.21.15.133:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d8140610 con 0x7fc3d80a5ba0 2023-09-30T01:55:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 -- 172.21.15.133:0/4170877137 <== mon.1 v1:172.21.15.133:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 254224620 0 0) 0x7fc3d00017f0 con 0x7fc3d80a5ba0 2023-09-30T01:55:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 -- 172.21.15.133:0/4170877137 >> v1:172.21.15.133:6789/0 conn(0x7fc3d80a5ba0 legacy=0x7fc3d814a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 --2- 172.21.15.133:0/4170877137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3c4003a60 0x7fc3c4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 --2- 172.21.15.133:0/4170877137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3c4004810 0x7fc3c4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 --2- 172.21.15.133:0/4170877137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3c40051c0 0x7fc3c400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 -- 172.21.15.133:0/4170877137 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d8140430 con 0x7fc3c40051c0 2023-09-30T01:55:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 -- 172.21.15.133:0/4170877137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c400c160 con 0x7fc3c4003a60 2023-09-30T01:55:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 -- 172.21.15.133:0/4170877137 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3c400c320 con 0x7fc3c4004810 2023-09-30T01:55:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3dd730700 1 --2- 172.21.15.133:0/4170877137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3c4003a60 0x7fc3c4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.514 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3dcf2f700 1 --2- 172.21.15.133:0/4170877137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3c4004810 0x7fc3c4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3ddf31700 1 --2- 172.21.15.133:0/4170877137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3c40051c0 0x7fc3c400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3dd730700 1 -- 172.21.15.133:0/4170877137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3c4004810 msgr2=0x7fc3c4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3dd730700 1 --2- 172.21.15.133:0/4170877137 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3c4004810 0x7fc3c4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3dd730700 1 -- 172.21.15.133:0/4170877137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3c40051c0 msgr2=0x7fc3c400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3dd730700 1 --2- 172.21.15.133:0/4170877137 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3c40051c0 0x7fc3c400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3dd730700 1 -- 172.21.15.133:0/4170877137 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3c4003570 con 0x7fc3c4003a60 2023-09-30T01:55:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3ddf31700 1 -- 172.21.15.133:0/4170877137 reap_dead start 2023-09-30T01:55:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3dd730700 1 --2- 172.21.15.133:0/4170877137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3c4003a60 0x7fc3c4003e70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009c00 tx=0x7fc3d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6a50b67608e5d05 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 -- 172.21.15.133:0/4170877137 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d400e710 con 0x7fc3c4003a60 2023-09-30T01:55:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 -- 172.21.15.133:0/4170877137 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d400e870 con 0x7fc3c4003a60 2023-09-30T01:55:39.515 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3cffff700 1 -- 172.21.15.133:0/4170877137 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d400ec30 con 0x7fc3c4003a60 2023-09-30T01:55:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3de732700 1 -- 172.21.15.133:0/4170877137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3c4003a60 msgr2=0x7fc3c4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.509+0000 7fc3de732700 1 --2- 172.21.15.133:0/4170877137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3c4003a60 0x7fc3c4003e70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc3d4009c00 tx=0x7fc3d40091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3de732700 1 -- 172.21.15.133:0/4170877137 shutdown_connections 2023-09-30T01:55:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3de732700 1 --2- 172.21.15.133:0/4170877137 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3c4003a60 0x7fc3c4003e70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.517 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3de732700 1 -- 172.21.15.133:0/4170877137 >> 172.21.15.133:0/4170877137 conn(0x7fc3d806abd0 msgr2=0x7fc3d806afd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:39.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3de732700 1 -- 172.21.15.133:0/4170877137 shutdown_connections 2023-09-30T01:55:39.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3de732700 1 -- 172.21.15.133:0/4170877137 wait complete. 2023-09-30T01:55:39.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3de732700 1 Processor -- start 2023-09-30T01:55:39.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3de732700 1 -- start start 2023-09-30T01:55:39.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3de732700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3c4003a60 0x7fc3d80aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3de732700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3d80ad680 0x7fc3d80ada70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3de732700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3d8144850 0x7fc3d8144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3de732700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d80ae520 con 0x7fc3c4003a60 2023-09-30T01:55:39.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3de732700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d81454e0 con 0x7fc3d8144850 2023-09-30T01:55:39.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3de732700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3d81457a0 con 0x7fc3d80ad680 2023-09-30T01:55:39.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3ddf31700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3d8144850 0x7fc3d8144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.518 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3ddf31700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3d8144850 0x7fc3d8144cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33912/0 (socket says 172.21.15.133:33912) 2023-09-30T01:55:39.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3ddf31700 1 -- 172.21.15.133:0/3542371966 learned_addr learned my addr 172.21.15.133:0/3542371966 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-09-30T01:55:39.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3dcf2f700 1 --2- 172.21.15.133:0/3542371966 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3d80ad680 0x7fc3d80ada70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.519 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.513+0000 7fc3dd730700 1 --2- 172.21.15.133:0/3542371966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3c4003a60 0x7fc3d80aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3ddf31700 1 -- 172.21.15.133:0/3542371966 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3d80ad680 msgr2=0x7fc3d80ada70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3ddf31700 1 --2- 172.21.15.133:0/3542371966 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3d80ad680 0x7fc3d80ada70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3ddf31700 1 -- 172.21.15.133:0/3542371966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3c4003a60 msgr2=0x7fc3d80aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3ddf31700 1 --2- 172.21.15.133:0/3542371966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3c4003a60 0x7fc3d80aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3ddf31700 1 -- 172.21.15.133:0/3542371966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d80ae790 con 0x7fc3d8144850 2023-09-30T01:55:39.520 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3ddf31700 1 --2- 172.21.15.133:0/3542371966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3d8144850 0x7fc3d8144cc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0001920 tx=0x7fc3d0001360 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3cd7fa700 1 -- 172.21.15.133:0/3542371966 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d000ebc0 con 0x7fc3d8144850 2023-09-30T01:55:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3cd7fa700 1 -- 172.21.15.133:0/3542371966 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d000ed40 con 0x7fc3d8144850 2023-09-30T01:55:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3de732700 1 -- 172.21.15.133:0/3542371966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3d80adfb0 con 0x7fc3d8144850 2023-09-30T01:55:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3cd7fa700 1 -- 172.21.15.133:0/3542371966 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0013670 con 0x7fc3d8144850 2023-09-30T01:55:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3de732700 1 -- 172.21.15.133:0/3542371966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3d8146170 con 0x7fc3d8144850 2023-09-30T01:55:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3cd7fa700 1 -- 172.21.15.133:0/3542371966 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc3d00139e0 con 0x7fc3d8144850 2023-09-30T01:55:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3cd7fa700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-09-30T01:55:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3cd7fa700 4 mgrc handle_mgr_map Got map version 1 2023-09-30T01:55:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3cd7fa700 4 mgrc handle_mgr_map Active mgr is now 2023-09-30T01:55:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3cd7fa700 4 mgrc reconnect No active mgr available yet 2023-09-30T01:55:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3cd7fa700 1 -- 172.21.15.133:0/3542371966 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7fc3d0013c90 con 0x7fc3d8144850 2023-09-30T01:55:39.521 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.517+0000 7fc3c2ffd700 1 -- 172.21.15.133:0/3542371966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3b80050b0 con 0x7fc3d8144850 2023-09-30T01:55:39.523 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.521+0000 7fc3cd7fa700 1 -- 172.21.15.133:0/3542371966 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc3d0027480 con 0x7fc3d8144850 2023-09-30T01:55:39.599 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.597+0000 7fc3c2ffd700 1 -- 172.21.15.133:0/3542371966 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "c48b2c87-a33c-47fc-8b84-e64faad378b0", "id": 2} v 0) v1 -- 0x7fc3b80053d0 con 0x7fc3d8144850 2023-09-30T01:55:39.609 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.605+0000 7fc3cd7fa700 1 -- 172.21.15.133:0/3542371966 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c48b2c87-a33c-47fc-8b84-e64faad378b0", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc3d00276c0 con 0x7fc3d8144850 2023-09-30T01:55:39.609 INFO:teuthology.orchestra.run.smithi133.stdout:2 2023-09-30T01:55:39.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.609+0000 7fc3c2ffd700 10 mgrc shutdown 2023-09-30T01:55:39.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.609+0000 7fc3c2ffd700 1 -- 172.21.15.133:0/3542371966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3d8144850 msgr2=0x7fc3d8144cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.609+0000 7fc3c2ffd700 1 --2- 172.21.15.133:0/3542371966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3d8144850 0x7fc3d8144cc0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc3d0001920 tx=0x7fc3d0001360 comp rx=0 tx=0).stop 2023-09-30T01:55:39.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.609+0000 7fc3c2ffd700 1 -- 172.21.15.133:0/3542371966 shutdown_connections 2023-09-30T01:55:39.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.609+0000 7fc3c2ffd700 1 --2- 172.21.15.133:0/3542371966 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc3d8144850 0x7fc3d8144cc0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.609+0000 7fc3c2ffd700 1 --2- 172.21.15.133:0/3542371966 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc3d80ad680 0x7fc3d80ada70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.609+0000 7fc3c2ffd700 1 --2- 172.21.15.133:0/3542371966 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc3c4003a60 0x7fc3d80aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.611 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.609+0000 7fc3c2ffd700 1 -- 172.21.15.133:0/3542371966 >> 172.21.15.133:0/3542371966 conn(0x7fc3d806abd0 msgr2=0x7fc3d80a1020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:39.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.609+0000 7fc3c2ffd700 1 -- 172.21.15.133:0/3542371966 shutdown_connections 2023-09-30T01:55:39.612 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.609+0000 7fc3c2ffd700 1 -- 172.21.15.133:0/3542371966 wait complete. 2023-09-30T01:55:39.612 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:39.609+0000 7fef20330000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T01:55:39.612 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:39.609+0000 7f0dd8946000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T01:55:39.626 DEBUG:teuthology.orchestra.run.smithi133:> sudo ceph --cluster ceph osd new 614c2d45-f7b8-42e8-ba09-6e042a2358b1 3 2023-09-30T01:55:39.669 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:39.665+0000 7f0dd8946000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T01:55:39.669 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:39.665+0000 7fef20330000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T01:55:39.684 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:39.680+0000 7f557d9d6000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-09-30T01:55:39.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.721+0000 7f1ca2038700 1 Processor -- start 2023-09-30T01:55:39.725 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.721+0000 7f1ca2038700 1 -- start start 2023-09-30T01:55:39.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1ca2038700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c9c0b0000 0x7f1c9c0a5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1ca2038700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c9c0a44c0 0x7f1c9c13c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1ca2038700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c9c0a5ea0 con 0x7f1c9c140440 2023-09-30T01:55:39.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1ca2038700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c9c140980 con 0x7f1c9c0b0000 2023-09-30T01:55:39.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1ca2038700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c140c40 con 0x7f1c9c0a44c0 2023-09-30T01:55:39.726 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1c9b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c9c0b0000 0x7f1c9c0a5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1c9b7fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1c9c0b0000 0x7f1c9c0a5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33928/0 (socket says 172.21.15.133:33928) 2023-09-30T01:55:39.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1c9b7fe700 1 -- 172.21.15.133:0/1402005807 learned_addr learned my addr 172.21.15.133:0/1402005807 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-09-30T01:55:39.727 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1c9affd700 1 --2- 172.21.15.133:0/1402005807 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c9c0a44c0 0x7f1c9c13c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1c9b7fe700 1 -- 172.21.15.133:0/1402005807 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c9c0a44c0 msgr2=0x7f1c9c13c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:39.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1c9b7fe700 1 --2- 172.21.15.133:0/1402005807 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c9c0a44c0 0x7f1c9c13c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1c9b7fe700 1 -- 172.21.15.133:0/1402005807 >> v1:172.21.15.55:6789/0 conn(0x7f1c9c140440 legacy=0x7f1c9c06bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.728 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1c9b7fe700 1 -- 172.21.15.133:0/1402005807 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c9c0a54a0 con 0x7f1c9c0b0000 2023-09-30T01:55:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1c9b7fe700 1 --2- 172.21.15.133:0/1402005807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9c0b0000 0x7f1c9c0a5960 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0099b0 tx=0x7f1c8c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=921b11e795ff04d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1c9a7fc700 1 -- 172.21.15.133:0/1402005807 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c009ea0 con 0x7f1c9c0b0000 2023-09-30T01:55:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1c9a7fc700 1 -- 172.21.15.133:0/1402005807 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8c00b8f0 con 0x7f1c9c0b0000 2023-09-30T01:55:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1c9a7fc700 1 -- 172.21.15.133:0/1402005807 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8c00bc90 con 0x7f1c9c0b0000 2023-09-30T01:55:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1ca2038700 1 -- 172.21.15.133:0/1402005807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9c0b0000 msgr2=0x7f1c9c0a5960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1ca2038700 1 --2- 172.21.15.133:0/1402005807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9c0b0000 0x7f1c9c0a5960 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0099b0 tx=0x7f1c8c009250 comp rx=0 tx=0).stop 2023-09-30T01:55:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1ca2038700 1 -- 172.21.15.133:0/1402005807 shutdown_connections 2023-09-30T01:55:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1ca2038700 1 --2- 172.21.15.133:0/1402005807 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c9c0a44c0 0x7f1c9c13c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.729 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1ca2038700 1 --2- 172.21.15.133:0/1402005807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9c0b0000 0x7f1c9c0a5960 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1ca2038700 1 -- 172.21.15.133:0/1402005807 >> 172.21.15.133:0/1402005807 conn(0x7f1c9c0681b0 msgr2=0x7f1c9c0685b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1ca2038700 1 -- 172.21.15.133:0/1402005807 shutdown_connections 2023-09-30T01:55:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1ca2038700 1 -- 172.21.15.133:0/1402005807 wait complete. 2023-09-30T01:55:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.725+0000 7f1ca2038700 1 Processor -- start 2023-09-30T01:55:39.730 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1ca2038700 1 -- start start 2023-09-30T01:55:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1ca2038700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c9c0a44c0 0x7f1c9c13c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1ca2038700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9c0b0000 0x7f1c9c144360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1ca2038700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c9c140440 0x7f1c9c13ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.733 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1ca2038700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c13c570 con 0x7f1c9c140440 2023-09-30T01:55:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1ca2038700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c141ea0 con 0x7f1c9c0b0000 2023-09-30T01:55:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1ca2038700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9c142160 con 0x7f1c9c0a44c0 2023-09-30T01:55:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c9affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9c0b0000 0x7f1c9c144360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c9affd700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9c0b0000 0x7f1c9c144360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.133:33930/0 (socket says 172.21.15.133:33930) 2023-09-30T01:55:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c9affd700 1 -- 172.21.15.133:0/933308161 learned_addr learned my addr 172.21.15.133:0/933308161 (peer_addr_for_me v2:172.21.15.133:0/0) 2023-09-30T01:55:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c9b7fe700 1 --2- 172.21.15.133:0/933308161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c9c0a44c0 0x7f1c9c13c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c9bfff700 1 --2- 172.21.15.133:0/933308161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c9c140440 0x7f1c9c13ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c9affd700 1 -- 172.21.15.133:0/933308161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c9c0a44c0 msgr2=0x7f1c9c13c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.734 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c9affd700 1 --2- 172.21.15.133:0/933308161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c9c0a44c0 0x7f1c9c13c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c9affd700 1 -- 172.21.15.133:0/933308161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c9c140440 msgr2=0x7f1c9c13ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c9affd700 1 --2- 172.21.15.133:0/933308161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c9c140440 0x7f1c9c13ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c9affd700 1 -- 172.21.15.133:0/933308161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c0094f0 con 0x7f1c9c0b0000 2023-09-30T01:55:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c9affd700 1 --2- 172.21.15.133:0/933308161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9c0b0000 0x7f1c9c144360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000ecb0 tx=0x7f1c900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c837fe700 1 -- 172.21.15.133:0/933308161 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9000c850 con 0x7f1c9c0b0000 2023-09-30T01:55:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c837fe700 1 -- 172.21.15.133:0/933308161 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c9000c9b0 con 0x7f1c9c0b0000 2023-09-30T01:55:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1ca2038700 1 -- 172.21.15.133:0/933308161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9c137080 con 0x7f1c9c0b0000 2023-09-30T01:55:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c837fe700 1 -- 172.21.15.133:0/933308161 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c9000cd50 con 0x7f1c9c0b0000 2023-09-30T01:55:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1ca2038700 1 -- 172.21.15.133:0/933308161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9c1448a0 con 0x7f1c9c0b0000 2023-09-30T01:55:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c837fe700 1 -- 172.21.15.133:0/933308161 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1c90005c80 con 0x7f1c9c0b0000 2023-09-30T01:55:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c837fe700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-09-30T01:55:39.735 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c837fe700 4 mgrc handle_mgr_map Got map version 1 2023-09-30T01:55:39.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c837fe700 4 mgrc handle_mgr_map Active mgr is now 2023-09-30T01:55:39.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c837fe700 4 mgrc reconnect No active mgr available yet 2023-09-30T01:55:39.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1c837fe700 1 -- 172.21.15.133:0/933308161 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f1c90013680 con 0x7f1c9c0b0000 2023-09-30T01:55:39.736 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.729+0000 7f1ca2038700 1 -- 172.21.15.133:0/933308161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9c06f660 con 0x7f1c9c0b0000 2023-09-30T01:55:39.737 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.733+0000 7f1c837fe700 1 -- 172.21.15.133:0/933308161 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1c90021060 con 0x7f1c9c0b0000 2023-09-30T01:55:39.743 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:39.740+0000 7f557d9d6000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-09-30T01:55:39.782 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:39.781+0000 7fef20330000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T01:55:39.786 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:39.785+0000 7f0dd8946000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T01:55:39.811 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.809+0000 7f1ca2038700 1 -- 172.21.15.133:0/933308161 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "osd new", "uuid": "614c2d45-f7b8-42e8-ba09-6e042a2358b1", "id": 3} v 0) v1 -- 0x7f1c9c04b5c0 con 0x7f1c9c0b0000 2023-09-30T01:55:39.820 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.817+0000 7f1c837fe700 1 -- 172.21.15.133:0/933308161 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "614c2d45-f7b8-42e8-ba09-6e042a2358b1", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f1c90029020 con 0x7f1c9c0b0000 2023-09-30T01:55:39.820 INFO:teuthology.orchestra.run.smithi133.stdout:3 2023-09-30T01:55:39.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.817+0000 7f1ca2038700 10 mgrc shutdown 2023-09-30T01:55:39.821 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.817+0000 7f1ca2038700 1 -- 172.21.15.133:0/933308161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9c0b0000 msgr2=0x7f1c9c144360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.817+0000 7f1ca2038700 1 --2- 172.21.15.133:0/933308161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9c0b0000 0x7f1c9c144360 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000ecb0 tx=0x7f1c900091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.817+0000 7f1ca2038700 1 -- 172.21.15.133:0/933308161 shutdown_connections 2023-09-30T01:55:39.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.817+0000 7f1ca2038700 1 --2- 172.21.15.133:0/933308161 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c9c140440 0x7f1c9c13ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.817+0000 7f1ca2038700 1 --2- 172.21.15.133:0/933308161 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c9c0b0000 0x7f1c9c144360 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.817+0000 7f1ca2038700 1 --2- 172.21.15.133:0/933308161 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c9c0a44c0 0x7f1c9c13c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.817+0000 7f1ca2038700 1 -- 172.21.15.133:0/933308161 >> 172.21.15.133:0/933308161 conn(0x7f1c9c0681b0 msgr2=0x7f1c9c0677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:39.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.817+0000 7f1ca2038700 1 -- 172.21.15.133:0/933308161 shutdown_connections 2023-09-30T01:55:39.822 INFO:teuthology.orchestra.run.smithi133.stderr:2023-09-30T01:55:39.817+0000 7f1ca2038700 1 -- 172.21.15.133:0/933308161 wait complete. 2023-09-30T01:55:39.833 INFO:tasks.ceph.osd.0:Restarting daemon 2023-09-30T01:55:39.833 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-09-30T01:55:39.835 INFO:tasks.ceph.osd.0:Started 2023-09-30T01:55:39.835 INFO:tasks.ceph.osd.1:Restarting daemon 2023-09-30T01:55:39.835 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-09-30T01:55:39.837 INFO:tasks.ceph.osd.1:Started 2023-09-30T01:55:39.837 INFO:tasks.ceph.osd.2:Restarting daemon 2023-09-30T01:55:39.838 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-09-30T01:55:39.840 INFO:tasks.ceph.osd.2:Started 2023-09-30T01:55:39.840 INFO:tasks.ceph.osd.3:Restarting daemon 2023-09-30T01:55:39.840 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-09-30T01:55:39.842 INFO:tasks.ceph.osd.3:Started 2023-09-30T01:55:39.842 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T01:55:39.862 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:39.860+0000 7f557d9d6000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-09-30T01:55:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.952+0000 7f0312129700 1 Processor -- start 2023-09-30T01:55:39.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.952+0000 7f0312129700 1 -- start start 2023-09-30T01:55:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f030c13d6c0 0x7f030c06c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f030c06ff20 0x7f030c13feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f030c070310 0x7f030c1403f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030c068750 con 0x7f030c070310 2023-09-30T01:55:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f030c06c810 con 0x7f030c06ff20 2023-09-30T01:55:39.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030c1409e0 con 0x7f030c13d6c0 2023-09-30T01:55:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0311127700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f030c13d6c0 0x7f030c06c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0311928700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f030c070310 0x7f030c1403f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0311928700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f030c070310 0x7f030c1403f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49410/0 (socket says 172.21.15.55:49410) 2023-09-30T01:55:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0311127700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f030c13d6c0 0x7f030c06c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:46212/0 (socket says 172.21.15.55:46212) 2023-09-30T01:55:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0311928700 1 -- 172.21.15.55:0/1465942173 learned_addr learned my addr 172.21.15.55:0/1465942173 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0310926700 1 --2- 172.21.15.55:0/1465942173 >> v2:172.21.15.133:3300/0 conn(0x7f030c06ff20 0x7f030c13feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0311127700 1 -- 172.21.15.55:0/1465942173 >> v2:172.21.15.133:3300/0 conn(0x7f030c06ff20 msgr2=0x7f030c13feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0311127700 1 --2- 172.21.15.55:0/1465942173 >> v2:172.21.15.133:3300/0 conn(0x7f030c06ff20 0x7f030c13feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0311127700 1 -- 172.21.15.55:0/1465942173 >> v2:172.21.15.55:3300/0 conn(0x7f030c070310 msgr2=0x7f030c1403f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0311127700 1 --2- 172.21.15.55:0/1465942173 >> v2:172.21.15.55:3300/0 conn(0x7f030c070310 0x7f030c1403f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0311127700 1 -- 172.21.15.55:0/1465942173 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f030c140ca0 con 0x7f030c13d6c0 2023-09-30T01:55:39.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0311928700 1 --2- 172.21.15.55:0/1465942173 >> v2:172.21.15.55:3300/0 conn(0x7f030c070310 0x7f030c1403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:55:39.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0311127700 1 --2- 172.21.15.55:0/1465942173 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f030c13d6c0 0x7f030c06c2d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f030c063750 tx=0x7f02fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2491868909ecbb4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:39.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0303fff700 1 -- 172.21.15.55:0/1465942173 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc011630 con 0x7f030c13d6c0 2023-09-30T01:55:39.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0303fff700 1 -- 172.21.15.55:0/1465942173 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f02fc0117b0 con 0x7f030c13d6c0 2023-09-30T01:55:39.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0303fff700 1 -- 172.21.15.55:0/1465942173 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f02fc011b70 con 0x7f030c13d6c0 2023-09-30T01:55:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 -- 172.21.15.55:0/1465942173 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f030c13d6c0 msgr2=0x7f030c06c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 --2- 172.21.15.55:0/1465942173 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f030c13d6c0 0x7f030c06c2d0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f030c063750 tx=0x7f02fc0091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 -- 172.21.15.55:0/1465942173 shutdown_connections 2023-09-30T01:55:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 --2- 172.21.15.55:0/1465942173 >> v2:172.21.15.133:3300/0 conn(0x7f030c06ff20 0x7f030c13feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 --2- 172.21.15.55:0/1465942173 >> v2:172.21.15.55:3300/0 conn(0x7f030c070310 0x7f030c1403f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 --2- 172.21.15.55:0/1465942173 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f030c13d6c0 0x7f030c06c2d0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 -- 172.21.15.55:0/1465942173 >> 172.21.15.55:0/1465942173 conn(0x7f030c0b2cf0 msgr2=0x7f030c0b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 -- 172.21.15.55:0/1465942173 shutdown_connections 2023-09-30T01:55:39.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 -- 172.21.15.55:0/1465942173 wait complete. 2023-09-30T01:55:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 Processor -- start 2023-09-30T01:55:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.956+0000 7f0312129700 1 -- start start 2023-09-30T01:55:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0312129700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f030c06ff20 0x7f030c13beb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0312129700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f030c13d6c0 0x7f030c0af7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0312129700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f030c150840 0x7f030c150ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0312129700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c1503b0 con 0x7f030c06ff20 2023-09-30T01:55:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0312129700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030c0afd30 con 0x7f030c150840 2023-09-30T01:55:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0312129700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030c0aab60 con 0x7f030c13d6c0 2023-09-30T01:55:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0310926700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f030c13d6c0 0x7f030c0af7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0310926700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f030c13d6c0 0x7f030c0af7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:46214/0 (socket says 172.21.15.55:46214) 2023-09-30T01:55:39.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0310926700 1 -- 172.21.15.55:0/940042711 learned_addr learned my addr 172.21.15.55:0/940042711 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0311127700 1 --2- 172.21.15.55:0/940042711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f030c06ff20 0x7f030c13beb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0311928700 1 --2- 172.21.15.55:0/940042711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f030c150840 0x7f030c150ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0310926700 1 -- 172.21.15.55:0/940042711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f030c150840 msgr2=0x7f030c150ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0310926700 1 --2- 172.21.15.55:0/940042711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f030c150840 0x7f030c150ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0310926700 1 -- 172.21.15.55:0/940042711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f030c06ff20 msgr2=0x7f030c13beb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0310926700 1 --2- 172.21.15.55:0/940042711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f030c06ff20 0x7f030c13beb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0310926700 1 -- 172.21.15.55:0/940042711 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0304009ae0 con 0x7f030c13d6c0 2023-09-30T01:55:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0310926700 1 --2- 172.21.15.55:0/940042711 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f030c13d6c0 0x7f030c0af7f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f030800ecb0 tx=0x7f03080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f03017fa700 1 -- 172.21.15.55:0/940042711 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030800c850 con 0x7f030c13d6c0 2023-09-30T01:55:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f03017fa700 1 -- 172.21.15.55:0/940042711 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030800c9d0 con 0x7f030c13d6c0 2023-09-30T01:55:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0312129700 1 -- 172.21.15.55:0/940042711 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f02fc009420 con 0x7f030c13d6c0 2023-09-30T01:55:39.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f03017fa700 1 -- 172.21.15.55:0/940042711 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f030800cd90 con 0x7f030c13d6c0 2023-09-30T01:55:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0312129700 1 -- 172.21.15.55:0/940042711 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f030c150030 con 0x7f030c13d6c0 2023-09-30T01:55:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f03017fa700 1 -- 172.21.15.55:0/940042711 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f0308005c80 con 0x7f030c13d6c0 2023-09-30T01:55:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f03017fa700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-09-30T01:55:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f03017fa700 4 mgrc handle_mgr_map Got map version 1 2023-09-30T01:55:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f03017fa700 4 mgrc handle_mgr_map Active mgr is now 2023-09-30T01:55:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f03017fa700 4 mgrc reconnect No active mgr available yet 2023-09-30T01:55:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f03017fa700 1 -- 172.21.15.55:0/940042711 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f0308013680 con 0x7f030c13d6c0 2023-09-30T01:55:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.960+0000 7f0312129700 1 -- 172.21.15.55:0/940042711 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f030c150560 con 0x7f030c13d6c0 2023-09-30T01:55:39.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:39.964+0000 7f03017fa700 1 -- 172.21.15.55:0/940042711 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f030c150560 con 0x7f030c13d6c0 2023-09-30T01:55:40.028 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:40.025+0000 7fef20330000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T01:55:40.029 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:40.025+0000 7f0dd8946000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T01:55:40.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:40.028+0000 7f0312129700 1 -- 172.21.15.55:0/940042711 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f030c064440 con 0x7f030c13d6c0 2023-09-30T01:55:40.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:40.028+0000 7f03017fa700 1 -- 172.21.15.55:0/940042711 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7f0308021060 con 0x7f030c13d6c0 2023-09-30T01:55:40.031 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:40.032 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"fsid":"37496c89-c485-46e5-8550-5722d2abf46a","created":"2023-09-30T01:55:38.697831+0000","modified":"2023-09-30T01:55:39.813210+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T01:55:39.813210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b52b4f6f-00aa-4ef8-b3d4-467475cd0bac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c48b2c87-a33c-47fc-8b84-e64faad378b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"614c2d45-f7b8-42e8-ba09-6e042a2358b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T01:55:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:40.028+0000 7f0312129700 10 mgrc shutdown 2023-09-30T01:55:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:40.028+0000 7f0312129700 1 -- 172.21.15.55:0/940042711 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f030c13d6c0 msgr2=0x7f030c0af7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:40.028+0000 7f0312129700 1 --2- 172.21.15.55:0/940042711 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f030c13d6c0 0x7f030c0af7f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f030800ecb0 tx=0x7f03080091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:40.028+0000 7f0312129700 1 -- 172.21.15.55:0/940042711 shutdown_connections 2023-09-30T01:55:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:40.028+0000 7f0312129700 1 --2- 172.21.15.55:0/940042711 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f030c150840 0x7f030c150ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:40.028+0000 7f0312129700 1 --2- 172.21.15.55:0/940042711 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f030c13d6c0 0x7f030c0af7f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:40.028+0000 7f0312129700 1 --2- 172.21.15.55:0/940042711 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f030c06ff20 0x7f030c13beb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:40.028+0000 7f0312129700 1 -- 172.21.15.55:0/940042711 >> 172.21.15.55:0/940042711 conn(0x7f030c0b2cf0 msgr2=0x7f030c06d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:40.028+0000 7f0312129700 1 -- 172.21.15.55:0/940042711 shutdown_connections 2023-09-30T01:55:40.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:40.028+0000 7f0312129700 1 -- 172.21.15.55:0/940042711 wait complete. 2023-09-30T01:55:40.044 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-09-30T01:55:40.044 INFO:tasks.ceph:Waiting for OSDs to come up 2023-09-30T01:55:40.075 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:40.073+0000 7fef20330000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T01:55:40.077 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:40.073+0000 7f0dd8946000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T01:55:40.113 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:40.108+0000 7f557d9d6000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-09-30T01:55:40.163 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:40.160+0000 7f557d9d6000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-09-30T01:55:40.253 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:40.249+0000 7f0dd8946000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T01:55:40.254 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:40.249+0000 7fef20330000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T01:55:40.315 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:40.313+0000 7f0dd8946000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T01:55:40.315 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:40.313+0000 7fef20330000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T01:55:40.334 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:40.332+0000 7f557d9d6000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-09-30T01:55:40.374 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:40.369+0000 7fef20330000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T01:55:40.377 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:40.373+0000 7f0dd8946000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T01:55:40.396 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:40.392+0000 7f557d9d6000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-09-30T01:55:40.446 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T01:55:40.447 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-09-30T01:55:40.445+0000 7f395b4e13c0 -1 Falling back to public interface 2023-09-30T01:55:40.458 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-09-30T01:55:40.457+0000 7f514b3033c0 -1 Falling back to public interface 2023-09-30T01:55:40.460 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:40.456+0000 7f557d9d6000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-09-30T01:55:40.470 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-09-30T01:55:40.468+0000 7f1d9e4e23c0 -1 Falling back to public interface 2023-09-30T01:55:40.474 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-09-30T01:55:40.473+0000 7f7105bb33c0 -1 Falling back to public interface 2023-09-30T01:55:40.542 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37ed89a700 1 Processor -- start 2023-09-30T01:55:40.543 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37ed89a700 1 -- start start 2023-09-30T01:55:40.544 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37ed89a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f37e81330f0 0x7f37e806e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:40.545 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37ed89a700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e80a6e50 con 0x7f37e80a7af0 2023-09-30T01:55:40.545 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37ed89a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37e8070620 con 0x7f37e8070250 2023-09-30T01:55:40.545 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37ed89a700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37e806df40 con 0x7f37e81330f0 2023-09-30T01:55:40.545 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37e7fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f37e80a7af0 0x7f37e806e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55390/0 (socket says 172.21.15.55:55390) 2023-09-30T01:55:40.545 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37e7fff700 1 -- 172.21.15.55:0/739210746 learned_addr learned my addr 172.21.15.55:0/739210746 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:55:40.545 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37ed099700 1 --2- 172.21.15.55:0/739210746 >> v2:172.21.15.55:3300/0 conn(0x7f37e81330f0 0x7f37e806e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:40.545 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37e77fe700 1 -- 172.21.15.55:0/739210746 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168341851 0 0) 0x7f37e80a6e50 con 0x7f37e80a7af0 2023-09-30T01:55:40.545 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37e77fe700 1 -- 172.21.15.55:0/739210746 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37d8003570 con 0x7f37e80a7af0 2023-09-30T01:55:40.545 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37e77fe700 1 -- 172.21.15.55:0/739210746 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1766698388 0 0) 0x7f37d8003570 con 0x7f37e80a7af0 2023-09-30T01:55:40.546 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37ed099700 1 -- 172.21.15.55:0/739210746 >> v1:172.21.15.133:6789/0 conn(0x7f37e8070250 legacy=0x7f37e806d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:40.546 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37ed099700 1 -- 172.21.15.55:0/739210746 >> v1:172.21.15.55:6789/0 conn(0x7f37e80a7af0 legacy=0x7f37e806e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:40.546 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37ed099700 1 -- 172.21.15.55:0/739210746 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e80a7350 con 0x7f37e81330f0 2023-09-30T01:55:40.546 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37ed099700 1 --2- 172.21.15.55:0/739210746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37e81330f0 0x7f37e806e910 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009e90 tx=0x7f37e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd31e03bf62cf8b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:40.546 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37e77fe700 1 -- 172.21.15.55:0/739210746 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e000e070 con 0x7f37e81330f0 2023-09-30T01:55:40.546 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37e77fe700 1 -- 172.21.15.55:0/739210746 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e000b920 con 0x7f37e81330f0 2023-09-30T01:55:40.546 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.540+0000 7f37e77fe700 1 -- 172.21.15.55:0/739210746 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d4001490 con 0x7f37e81330f0 2023-09-30T01:55:40.547 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.544+0000 7f37ed89a700 1 -- 172.21.15.55:0/739210746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37e81330f0 msgr2=0x7f37e806e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:40.547 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.544+0000 7f37ed89a700 1 --2- 172.21.15.55:0/739210746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37e81330f0 0x7f37e806e910 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f37e0009e90 tx=0x7f37e0009780 comp rx=0 tx=0).stop 2023-09-30T01:55:40.548 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.544+0000 7f37ed89a700 1 -- 172.21.15.55:0/739210746 shutdown_connections 2023-09-30T01:55:40.548 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.544+0000 7f37ed89a700 1 --2- 172.21.15.55:0/739210746 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37e81330f0 0x7f37e806e910 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:40.548 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.544+0000 7f37ed89a700 1 -- 172.21.15.55:0/739210746 >> 172.21.15.55:0/739210746 conn(0x7f37e80630a0 msgr2=0x7f37e806a4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:40.548 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.544+0000 7f37ed89a700 1 -- 172.21.15.55:0/739210746 shutdown_connections 2023-09-30T01:55:40.548 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.544+0000 7f37ed89a700 1 -- 172.21.15.55:0/739210746 wait complete. 2023-09-30T01:55:40.548 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.544+0000 7f37ed89a700 1 Processor -- start 2023-09-30T01:55:40.548 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.544+0000 7f37ed89a700 1 -- start start 2023-09-30T01:55:40.551 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed89a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37e8070250 0x7f37e81458d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:40.551 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed89a700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37e80a7af0 0x7f37e80a3a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:40.551 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed89a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37e81330f0 0x7f37e80a1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:40.551 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed89a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e8145e10 con 0x7f37e81330f0 2023-09-30T01:55:40.552 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed89a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37e81453b0 con 0x7f37e8070250 2023-09-30T01:55:40.552 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed89a700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37e8146000 con 0x7f37e80a7af0 2023-09-30T01:55:40.552 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37e7fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37e80a7af0 0x7f37e80a3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:40.552 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed099700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37e81330f0 0x7f37e80a1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:40.552 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37e7fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37e80a7af0 0x7f37e80a3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:46226/0 (socket says 172.21.15.55:46226) 2023-09-30T01:55:40.552 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37e7fff700 1 -- 172.21.15.55:0/741542540 learned_addr learned my addr 172.21.15.55:0/741542540 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:40.552 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ec898700 1 --2- 172.21.15.55:0/741542540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37e8070250 0x7f37e81458d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:40.552 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed099700 1 -- 172.21.15.55:0/741542540 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37e80a7af0 msgr2=0x7f37e80a3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:40.552 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed099700 1 --2- 172.21.15.55:0/741542540 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37e80a7af0 0x7f37e80a3a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:40.552 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed099700 1 -- 172.21.15.55:0/741542540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37e8070250 msgr2=0x7f37e81458d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:40.552 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed099700 1 --2- 172.21.15.55:0/741542540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37e8070250 0x7f37e81458d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:40.553 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed099700 1 -- 172.21.15.55:0/741542540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37e0009a20 con 0x7f37e81330f0 2023-09-30T01:55:40.553 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37e7fff700 1 --2- 172.21.15.55:0/741542540 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37e80a7af0 0x7f37e80a3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:55:40.553 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed099700 1 --2- 172.21.15.55:0/741542540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37e81330f0 0x7f37e80a1090 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f37e0014000 tx=0x7f37e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:40.553 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37e4ff9700 1 -- 172.21.15.55:0/741542540 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e0012cc0 con 0x7f37e81330f0 2023-09-30T01:55:40.553 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37e4ff9700 1 -- 172.21.15.55:0/741542540 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37e0012e60 con 0x7f37e81330f0 2023-09-30T01:55:40.553 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed89a700 1 -- 172.21.15.55:0/741542540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37e81462a0 con 0x7f37e81330f0 2023-09-30T01:55:40.553 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37e4ff9700 1 -- 172.21.15.55:0/741542540 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37e001e6a0 con 0x7f37e81330f0 2023-09-30T01:55:40.553 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed89a700 1 -- 172.21.15.55:0/741542540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37e81481e0 con 0x7f37e81330f0 2023-09-30T01:55:40.553 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37e4ff9700 1 -- 172.21.15.55:0/741542540 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f37e001ea90 con 0x7f37e81330f0 2023-09-30T01:55:40.553 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37e4ff9700 20 mgrc handle_mgr_map mgrmap(e 1) v1 2023-09-30T01:55:40.553 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37e4ff9700 4 mgrc handle_mgr_map Got map version 1 2023-09-30T01:55:40.553 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37e4ff9700 4 mgrc handle_mgr_map Active mgr is now 2023-09-30T01:55:40.554 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37e4ff9700 4 mgrc reconnect No active mgr available yet 2023-09-30T01:55:40.554 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37e4ff9700 1 -- 172.21.15.55:0/741542540 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f37e001ed40 con 0x7f37e81330f0 2023-09-30T01:55:40.554 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.548+0000 7f37ed89a700 1 -- 172.21.15.55:0/741542540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37e8064440 con 0x7f37e81330f0 2023-09-30T01:55:40.554 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.552+0000 7f37e4ff9700 1 -- 172.21.15.55:0/741542540 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f37e002b060 con 0x7f37e81330f0 2023-09-30T01:55:40.617 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.616+0000 7f37ed89a700 1 -- 172.21.15.55:0/741542540 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37e813eca0 con 0x7f37e81330f0 2023-09-30T01:55:40.618 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.616+0000 7f37e4ff9700 1 -- 172.21.15.55:0/741542540 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+4108 (secure 0 0 0) 0x7f37e0016020 con 0x7f37e81330f0 2023-09-30T01:55:40.618 INFO:teuthology.misc.health.smithi055.stdout: 2023-09-30T01:55:40.618 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":6,"fsid":"37496c89-c485-46e5-8550-5722d2abf46a","created":"2023-09-30T01:55:38.697831+0000","modified":"2023-09-30T01:55:39.813210+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T01:55:39.813210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b52b4f6f-00aa-4ef8-b3d4-467475cd0bac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c48b2c87-a33c-47fc-8b84-e64faad378b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"614c2d45-f7b8-42e8-ba09-6e042a2358b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T01:55:40.620 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.616+0000 7f37ed89a700 10 mgrc shutdown 2023-09-30T01:55:40.620 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.616+0000 7f37ed89a700 1 -- 172.21.15.55:0/741542540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37e81330f0 msgr2=0x7f37e80a1090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:40.620 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.616+0000 7f37ed89a700 1 --2- 172.21.15.55:0/741542540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37e81330f0 0x7f37e80a1090 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f37e0014000 tx=0x7f37e0017000 comp rx=0 tx=0).stop 2023-09-30T01:55:40.620 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.616+0000 7f37ed89a700 1 -- 172.21.15.55:0/741542540 shutdown_connections 2023-09-30T01:55:40.620 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.616+0000 7f37ed89a700 1 --2- 172.21.15.55:0/741542540 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f37e81330f0 0x7f37e80a1090 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:40.620 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.616+0000 7f37ed89a700 1 --2- 172.21.15.55:0/741542540 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f37e80a7af0 0x7f37e80a3a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:40.620 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.616+0000 7f37ed89a700 1 --2- 172.21.15.55:0/741542540 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f37e8070250 0x7f37e81458d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:40.620 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.616+0000 7f37ed89a700 1 -- 172.21.15.55:0/741542540 >> 172.21.15.55:0/741542540 conn(0x7f37e80630a0 msgr2=0x7f37e80a44f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:40.621 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.616+0000 7f37ed89a700 1 -- 172.21.15.55:0/741542540 shutdown_connections 2023-09-30T01:55:40.621 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:40.616+0000 7f37ed89a700 1 -- 172.21.15.55:0/741542540 wait complete. 2023-09-30T01:55:40.628 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-09-30T01:55:40.781 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:40.777+0000 7fef20330000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T01:55:40.784 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:40.781+0000 7f0dd8946000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T01:55:40.845 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:40.840+0000 7f557d9d6000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-09-30T01:55:40.896 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:40.893+0000 7fef20330000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T01:55:40.899 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:40.897+0000 7f0dd8946000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T01:55:40.961 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:40.956+0000 7f557d9d6000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-09-30T01:55:41.193 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:41.189+0000 7fef20330000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T01:55:41.210 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:41.205+0000 7f0dd8946000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T01:55:41.260 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:41.256+0000 7f557d9d6000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-09-30T01:55:41.359 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:41.357+0000 7fef20330000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T01:55:41.368 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:41.365+0000 7f0dd8946000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T01:55:41.429 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:41.425+0000 7fef20330000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T01:55:41.430 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:41.425+0000 7f0dd8946000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T01:55:41.431 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:41.428+0000 7f557d9d6000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-09-30T01:55:41.483 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:41.481+0000 7fef20330000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T01:55:41.483 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:41.481+0000 7f0dd8946000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T01:55:41.499 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:41.496+0000 7f557d9d6000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-09-30T01:55:41.541 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:41.537+0000 7fef20330000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T01:55:41.550 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:41.549+0000 7f0dd8946000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T01:55:41.552 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:41.548+0000 7f557d9d6000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-09-30T01:55:41.612 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:41.608+0000 7f557d9d6000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-09-30T01:55:41.901 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:41.896+0000 7f557d9d6000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T01:55:41.936 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:41.933+0000 7f0dd8946000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T01:55:41.936 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:41.933+0000 7fef20330000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-09-30T01:55:41.960 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:41.956+0000 7f557d9d6000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T01:55:41.994 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:41.993+0000 7fef20330000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T01:55:41.994 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:41.993+0000 7f0dd8946000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-09-30T01:55:42.030 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:42.024+0000 7f557d9d6000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T01:55:42.064 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:42.061+0000 7f0dd8946000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T01:55:42.064 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:42.061+0000 7fef20330000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-09-30T01:55:42.195 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:42.192+0000 7f557d9d6000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T01:55:42.229 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:42.225+0000 7fef20330000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T01:55:42.230 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:42.229+0000 7f0dd8946000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-09-30T01:55:42.263 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:42.260+0000 7f557d9d6000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T01:55:42.296 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:42.293+0000 7f0dd8946000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T01:55:42.297 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:42.293+0000 7fef20330000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-09-30T01:55:42.984 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:42.980+0000 7f557d9d6000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T01:55:43.020 INFO:tasks.ceph.mgr.y.smithi133.stderr:2023-09-30T01:55:43.017+0000 7f0dd8946000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T01:55:43.020 INFO:tasks.ceph.mgr.z.smithi133.stderr:2023-09-30T01:55:43.017+0000 7fef20330000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-09-30T01:55:43.046 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:43.044+0000 7f555b2b7700 -1 log_channel(cluster) log [ERR] : Unhandled exception from module 'pg_autoscaler' while running on mgr.x: 'PgAutoscaler' object has no attribute 'noautoscale' 2023-09-30T01:55:43.046 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:43.044+0000 7f555b2b7700 -1 pg_autoscaler.serve: 2023-09-30T01:55:43.047 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:43.044+0000 7f555b2b7700 -1 Traceback (most recent call last): 2023-09-30T01:55:43.048 INFO:tasks.ceph.mgr.x.smithi055.stderr: File "/usr/share/ceph/mgr/pg_autoscaler/module.py", line 325, in serve 2023-09-30T01:55:43.048 INFO:tasks.ceph.mgr.x.smithi055.stderr: self._maybe_adjust() 2023-09-30T01:55:43.048 INFO:tasks.ceph.mgr.x.smithi055.stderr: File "/usr/share/ceph/mgr/pg_autoscaler/module.py", line 682, in _maybe_adjust 2023-09-30T01:55:43.048 INFO:tasks.ceph.mgr.x.smithi055.stderr: if self.noautoscale: 2023-09-30T01:55:43.048 INFO:tasks.ceph.mgr.x.smithi055.stderr:AttributeError: 'PgAutoscaler' object has no attribute 'noautoscale' 2023-09-30T01:55:43.048 INFO:tasks.ceph.mgr.x.smithi055.stderr: 2023-09-30T01:55:43.641 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:55:43.644 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:55:44.040 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:44.036+0000 7f5566ace700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-09-30T01:55:44.042 INFO:tasks.ceph.mgr.x.smithi055.stderr:2023-09-30T01:55:44.040+0000 7f5566ace700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-09-30T01:55:44.067 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-09-30T01:55:44.065+0000 7f395b4e13c0 -1 osd.3 0 log_to_monitors true 2023-09-30T01:55:44.306 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-09-30T01:55:44.304+0000 7f1d9e4e23c0 -1 osd.0 0 log_to_monitors true 2023-09-30T01:55:44.365 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-09-30T01:55:44.361+0000 7f514b3033c0 -1 osd.1 0 log_to_monitors true 2023-09-30T01:55:44.387 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-09-30T01:55:44.385+0000 7f7105bb33c0 -1 osd.2 0 log_to_monitors true 2023-09-30T01:55:47.032 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T01:55:47.137 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.132+0000 7fd28f59e700 1 Processor -- start 2023-09-30T01:55:47.137 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.132+0000 7fd28f59e700 1 -- start start 2023-09-30T01:55:47.141 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28f59e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd29006e7e0 0x7fd2901418e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:47.141 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28f59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fd290141e20 0x7fd290135800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:47.141 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28f59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd29006e070 con 0x7fd290142c60 2023-09-30T01:55:47.141 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28f59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2901422a0 con 0x7fd290141e20 2023-09-30T01:55:47.142 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28f59e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd290142550 con 0x7fd29006e7e0 2023-09-30T01:55:47.142 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28dd9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd29006e7e0 0x7fd2901418e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:47.142 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28dd9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd29006e7e0 0x7fd2901418e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:38914/0 (socket says 172.21.15.55:38914) 2023-09-30T01:55:47.142 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28dd9b700 1 -- 172.21.15.55:0/1955874834 learned_addr learned my addr 172.21.15.55:0/1955874834 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:47.142 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28ed9d700 1 --2- 172.21.15.55:0/1955874834 >> v2:172.21.15.133:3300/0 conn(0x7fd290141e20 0x7fd290135800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:47.144 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28d59a700 1 -- 172.21.15.55:0/1955874834 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 146749398 0 0) 0x7fd29006e070 con 0x7fd290142c60 2023-09-30T01:55:47.144 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28dd9b700 1 -- 172.21.15.55:0/1955874834 >> v2:172.21.15.133:3300/0 conn(0x7fd290141e20 msgr2=0x7fd290135800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:47.144 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28dd9b700 1 --2- 172.21.15.55:0/1955874834 >> v2:172.21.15.133:3300/0 conn(0x7fd290141e20 0x7fd290135800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:47.144 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28dd9b700 1 -- 172.21.15.55:0/1955874834 >> v1:172.21.15.133:6789/0 conn(0x7fd290142c60 legacy=0x7fd290070020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:47.144 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28dd9b700 1 -- 172.21.15.55:0/1955874834 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd290142810 con 0x7fd29006e7e0 2023-09-30T01:55:47.144 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28dd9b700 1 --2- 172.21.15.55:0/1955874834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd29006e7e0 0x7fd2901418e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd2840099b0 tx=0x7fd284009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3723ec43524991df server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:47.144 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28d59a700 1 -- 172.21.15.55:0/1955874834 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd284009ea0 con 0x7fd29006e7e0 2023-09-30T01:55:47.144 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28d59a700 1 -- 172.21.15.55:0/1955874834 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd28400b860 con 0x7fd29006e7e0 2023-09-30T01:55:47.144 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28d59a700 1 -- 172.21.15.55:0/1955874834 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd28400bc00 con 0x7fd29006e7e0 2023-09-30T01:55:47.145 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28f59e700 1 -- 172.21.15.55:0/1955874834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd29006e7e0 msgr2=0x7fd2901418e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:47.145 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28f59e700 1 --2- 172.21.15.55:0/1955874834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd29006e7e0 0x7fd2901418e0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd2840099b0 tx=0x7fd284009250 comp rx=0 tx=0).stop 2023-09-30T01:55:47.145 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28f59e700 1 -- 172.21.15.55:0/1955874834 shutdown_connections 2023-09-30T01:55:47.145 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28f59e700 1 --2- 172.21.15.55:0/1955874834 >> v2:172.21.15.133:3300/0 conn(0x7fd290141e20 0x7fd290135800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:47.145 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28f59e700 1 --2- 172.21.15.55:0/1955874834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd29006e7e0 0x7fd2901418e0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:47.145 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28f59e700 1 -- 172.21.15.55:0/1955874834 >> 172.21.15.55:0/1955874834 conn(0x7fd2900b2d90 msgr2=0x7fd2900b3190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:47.145 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28f59e700 1 -- 172.21.15.55:0/1955874834 shutdown_connections 2023-09-30T01:55:47.145 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.136+0000 7fd28f59e700 1 -- 172.21.15.55:0/1955874834 wait complete. 2023-09-30T01:55:47.147 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28f59e700 1 Processor -- start 2023-09-30T01:55:47.147 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28f59e700 1 -- start start 2023-09-30T01:55:47.147 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28f59e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd29006e7e0 0x7fd29013a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:47.147 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28f59e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd290141e20 0x7fd290135f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:47.147 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd290142c60 0x7fd290150190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:47.148 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28f59e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd29013a5f0 con 0x7fd290141e20 2023-09-30T01:55:47.148 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd290150b60 con 0x7fd290142c60 2023-09-30T01:55:47.148 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28f59e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd290150e20 con 0x7fd29006e7e0 2023-09-30T01:55:47.148 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28e59c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd29006e7e0 0x7fd29013a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:47.148 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28e59c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd29006e7e0 0x7fd29013a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:38930/0 (socket says 172.21.15.55:38930) 2023-09-30T01:55:47.148 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28e59c700 1 -- 172.21.15.55:0/1731019118 learned_addr learned my addr 172.21.15.55:0/1731019118 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:47.148 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28ed9d700 1 --2- 172.21.15.55:0/1731019118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd290142c60 0x7fd290150190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:47.148 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28dd9b700 1 --2- 172.21.15.55:0/1731019118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd290141e20 0x7fd290135f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:47.148 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28e59c700 1 -- 172.21.15.55:0/1731019118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd290142c60 msgr2=0x7fd290150190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:47.148 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28e59c700 1 --2- 172.21.15.55:0/1731019118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd290142c60 0x7fd290150190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:47.148 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28e59c700 1 -- 172.21.15.55:0/1731019118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd290141e20 msgr2=0x7fd290135f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:47.149 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28e59c700 1 --2- 172.21.15.55:0/1731019118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd290141e20 0x7fd290135f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:47.149 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28e59c700 1 -- 172.21.15.55:0/1731019118 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2840094f0 con 0x7fd29006e7e0 2023-09-30T01:55:47.149 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28e59c700 1 --2- 172.21.15.55:0/1731019118 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd29006e7e0 0x7fd29013a0b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd28800c910 tx=0x7fd288001700 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:47.149 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd27e7fc700 1 -- 172.21.15.55:0/1731019118 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288012630 con 0x7fd29006e7e0 2023-09-30T01:55:47.149 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd27e7fc700 1 -- 172.21.15.55:0/1731019118 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2880127b0 con 0x7fd29006e7e0 2023-09-30T01:55:47.149 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28f59e700 1 -- 172.21.15.55:0/1731019118 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2900b0800 con 0x7fd29006e7e0 2023-09-30T01:55:47.149 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd27e7fc700 1 -- 172.21.15.55:0/1731019118 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd288012b70 con 0x7fd29006e7e0 2023-09-30T01:55:47.149 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.140+0000 7fd28f59e700 1 -- 172.21.15.55:0/1731019118 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd290136510 con 0x7fd29006e7e0 2023-09-30T01:55:47.149 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.144+0000 7fd28f59e700 1 -- 172.21.15.55:0/1731019118 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd290064440 con 0x7fd29006e7e0 2023-09-30T01:55:47.150 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.144+0000 7fd27e7fc700 1 -- 172.21.15.55:0/1731019118 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 4) v1 ==== 119683+0+0 (secure 0 0 0) 0x7fd288003030 con 0x7fd29006e7e0 2023-09-30T01:55:47.150 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.144+0000 7fd27e7fc700 20 mgrc handle_mgr_map mgrmap(e 4) v1 2023-09-30T01:55:47.150 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.148+0000 7fd27e7fc700 4 mgrc handle_mgr_map Got map version 4 2023-09-30T01:55:47.150 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.148+0000 7fd27e7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:47.150 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.148+0000 7fd27e7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:47.151 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.148+0000 7fd27e7fc700 1 --2- 172.21.15.55:0/1731019118 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd27008e820 0x7fd270090cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:47.151 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.148+0000 7fd28dd9b700 1 --2- 172.21.15.55:0/1731019118 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd27008e820 0x7fd270090cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:47.151 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.148+0000 7fd27e7fc700 1 -- 172.21.15.55:0/1731019118 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1619+0+0 (secure 0 0 0) 0x7fd2880b4380 con 0x7fd29006e7e0 2023-09-30T01:55:47.151 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.148+0000 7fd28dd9b700 1 --2- 172.21.15.55:0/1731019118 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd27008e820 0x7fd270090cd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd2840099b0 tx=0x7fd284017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:47.153 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.152+0000 7fd27e7fc700 1 -- 172.21.15.55:0/1731019118 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd288085920 con 0x7fd29006e7e0 2023-09-30T01:55:47.181 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-09-30T01:55:47.180+0000 7f1d9b4a7700 -1 osd.0 0 waiting for initial osdmap 2023-09-30T01:55:47.201 INFO:tasks.ceph.osd.0.smithi055.stderr:2023-09-30T01:55:47.200+0000 7f1d92a26700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T01:55:47.319 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.316+0000 7fd28f59e700 1 -- 172.21.15.55:0/1731019118 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd290143030 con 0x7fd29006e7e0 2023-09-30T01:55:47.320 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.316+0000 7fd27e7fc700 1 -- 172.21.15.55:0/1731019118 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v8) v1 ==== 74+0+4108 (secure 0 0 0) 0x7fd288088f40 con 0x7fd29006e7e0 2023-09-30T01:55:47.320 INFO:teuthology.misc.health.smithi055.stdout: 2023-09-30T01:55:47.320 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":8,"fsid":"37496c89-c485-46e5-8550-5722d2abf46a","created":"2023-09-30T01:55:38.697831+0000","modified":"2023-09-30T01:55:46.038167+0000","last_up_change":"0.000000","last_in_change":"2023-09-30T01:55:39.813210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"b52b4f6f-00aa-4ef8-b3d4-467475cd0bac","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"c48b2c87-a33c-47fc-8b84-e64faad378b0","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"614c2d45-f7b8-42e8-ba09-6e042a2358b1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T01:55:47.322 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.320+0000 7fd28f59e700 10 mgrc shutdown 2023-09-30T01:55:47.323 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.320+0000 7fd28f59e700 1 -- 172.21.15.55:0/1731019118 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd27008e820 msgr2=0x7fd270090cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:47.323 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.320+0000 7fd28f59e700 1 --2- 172.21.15.55:0/1731019118 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd27008e820 0x7fd270090cd0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fd2840099b0 tx=0x7fd284017000 comp rx=0 tx=0).stop 2023-09-30T01:55:47.323 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.320+0000 7fd28f59e700 1 -- 172.21.15.55:0/1731019118 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd29006e7e0 msgr2=0x7fd29013a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:47.323 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.320+0000 7fd28f59e700 1 --2- 172.21.15.55:0/1731019118 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd29006e7e0 0x7fd29013a0b0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fd28800c910 tx=0x7fd288001700 comp rx=0 tx=0).stop 2023-09-30T01:55:47.323 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.320+0000 7fd28f59e700 1 -- 172.21.15.55:0/1731019118 shutdown_connections 2023-09-30T01:55:47.323 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.320+0000 7fd28f59e700 1 --2- 172.21.15.55:0/1731019118 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd290142c60 0x7fd290150190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:47.323 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.320+0000 7fd28f59e700 1 --2- 172.21.15.55:0/1731019118 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd290141e20 0x7fd290135f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:47.323 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.320+0000 7fd28f59e700 1 --2- 172.21.15.55:0/1731019118 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd27008e820 0x7fd270090cd0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:47.323 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.320+0000 7fd28f59e700 1 --2- 172.21.15.55:0/1731019118 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd29006e7e0 0x7fd29013a0b0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:47.324 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.320+0000 7fd28f59e700 1 -- 172.21.15.55:0/1731019118 >> 172.21.15.55:0/1731019118 conn(0x7fd2900b2d90 msgr2=0x7fd2900677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:47.324 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.320+0000 7fd28f59e700 1 -- 172.21.15.55:0/1731019118 shutdown_connections 2023-09-30T01:55:47.324 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:47.320+0000 7fd28f59e700 1 -- 172.21.15.55:0/1731019118 wait complete. 2023-09-30T01:55:47.333 DEBUG:teuthology.misc:0 of 4 OSDs are up 2023-09-30T01:55:47.906 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-09-30T01:55:47.905+0000 7f7102b78700 -1 osd.2 0 waiting for initial osdmap 2023-09-30T01:55:47.913 INFO:tasks.ceph.osd.2.smithi133.stderr:2023-09-30T01:55:47.909+0000 7f70fa0f7700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T01:55:47.941 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-09-30T01:55:47.937+0000 7f5146aa3700 -1 osd.1 0 waiting for initial osdmap 2023-09-30T01:55:47.944 INFO:tasks.ceph.osd.1.smithi133.stderr:2023-09-30T01:55:47.941+0000 7f513f847700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T01:55:47.947 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-09-30T01:55:47.945+0000 7f39584a6700 -1 osd.3 0 waiting for initial osdmap 2023-09-30T01:55:47.954 INFO:tasks.ceph.osd.3.smithi133.stderr:2023-09-30T01:55:47.953+0000 7f394fa25700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-09-30T01:55:49.091 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-09-30T01:55:49.088+0000 7f567d94f700 -1 log_channel(cluster) log [ERR] : Health check failed: Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale' (MGR_MODULE_ERROR) 2023-09-30T01:55:53.736 DEBUG:teuthology.orchestra.run.smithi055:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-09-30T01:55:53.839 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.836+0000 7f1c0745c700 1 Processor -- start 2023-09-30T01:55:53.840 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.836+0000 7f1c0745c700 1 -- start start 2023-09-30T01:55:53.841 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.836+0000 7f1c0745c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1c0006b3f0 0x7f1c000a6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:53.842 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.836+0000 7f1c0745c700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0006b850 con 0x7f1c0006cbe0 2023-09-30T01:55:53.842 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.836+0000 7f1c0745c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c0006d0d0 con 0x7f1c000a2d50 2023-09-30T01:55:53.842 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.836+0000 7f1c0745c700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c000a74b0 con 0x7f1c0006b3f0 2023-09-30T01:55:53.842 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.836+0000 7f1c05c59700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1c0006b3f0 0x7f1c000a6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:53.842 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.836+0000 7f1c06c5b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1c0006cbe0 0x7f1c0006bce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60138/0 (socket says 172.21.15.55:60138) 2023-09-30T01:55:53.842 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.836+0000 7f1c06c5b700 1 -- 172.21.15.55:0/2068275794 learned_addr learned my addr 172.21.15.55:0/2068275794 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:55:53.842 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.836+0000 7f1c05458700 1 -- 172.21.15.55:0/2068275794 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3473185079 0 0) 0x7f1c0006b850 con 0x7f1c0006cbe0 2023-09-30T01:55:53.843 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.836+0000 7f1c05458700 1 -- 172.21.15.55:0/2068275794 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bec003570 con 0x7f1c0006cbe0 2023-09-30T01:55:53.843 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.836+0000 7f1c05c59700 1 -- 172.21.15.55:0/2068275794 >> v1:172.21.15.133:6789/0 conn(0x7f1c000a2d50 legacy=0x7f1c000a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:53.843 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.836+0000 7f1c05c59700 1 -- 172.21.15.55:0/2068275794 >> v1:172.21.15.55:6789/0 conn(0x7f1c0006cbe0 legacy=0x7f1c0006bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:53.843 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.836+0000 7f1c05c59700 1 -- 172.21.15.55:0/2068275794 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c00132a50 con 0x7f1c0006b3f0 2023-09-30T01:55:53.843 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.840+0000 7f1c05c59700 1 --2- 172.21.15.55:0/2068275794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c0006b3f0 0x7f1c000a6f70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00098e0 tx=0x7f1bf00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b99a645da81a943 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:53.843 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.840+0000 7f1c05458700 1 -- 172.21.15.55:0/2068275794 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf000b640 con 0x7f1c0006b3f0 2023-09-30T01:55:53.843 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.840+0000 7f1c05458700 1 -- 172.21.15.55:0/2068275794 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf000b7a0 con 0x7f1c0006b3f0 2023-09-30T01:55:53.843 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.840+0000 7f1c05458700 1 -- 172.21.15.55:0/2068275794 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf000bb40 con 0x7f1c0006b3f0 2023-09-30T01:55:53.844 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.840+0000 7f1c0745c700 1 -- 172.21.15.55:0/2068275794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c0006b3f0 msgr2=0x7f1c000a6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:53.845 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.840+0000 7f1c0745c700 1 --2- 172.21.15.55:0/2068275794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c0006b3f0 0x7f1c000a6f70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f1bf00098e0 tx=0x7f1bf00091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:53.845 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.840+0000 7f1c0745c700 1 -- 172.21.15.55:0/2068275794 shutdown_connections 2023-09-30T01:55:53.845 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.840+0000 7f1c0745c700 1 --2- 172.21.15.55:0/2068275794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c0006b3f0 0x7f1c000a6f70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:53.845 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.840+0000 7f1c0745c700 1 -- 172.21.15.55:0/2068275794 >> 172.21.15.55:0/2068275794 conn(0x7f1c000b2d90 msgr2=0x7f1c000b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:53.845 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.840+0000 7f1c0745c700 1 -- 172.21.15.55:0/2068275794 shutdown_connections 2023-09-30T01:55:53.846 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.840+0000 7f1c0745c700 1 -- 172.21.15.55:0/2068275794 wait complete. 2023-09-30T01:55:53.846 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.840+0000 7f1c0745c700 1 Processor -- start 2023-09-30T01:55:53.846 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.840+0000 7f1c0745c700 1 -- start start 2023-09-30T01:55:53.848 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c0745c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c0006b3f0 0x7f1c0012e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:53.848 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c0745c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c0006cbe0 0x7f1c001374f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:53.848 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c0745c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c000a2d50 0x7f1c000a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:53.848 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c0745c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c001500c0 con 0x7f1c000a2d50 2023-09-30T01:55:53.848 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c0745c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c00150380 con 0x7f1c0006cbe0 2023-09-30T01:55:53.849 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c0745c700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c00150640 con 0x7f1c0006b3f0 2023-09-30T01:55:53.849 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c0645a700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c0006b3f0 0x7f1c0012e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:53.849 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c06c5b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c000a2d50 0x7f1c000a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:53.849 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c0645a700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c0006b3f0 0x7f1c0012e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56670/0 (socket says 172.21.15.55:56670) 2023-09-30T01:55:53.849 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c0645a700 1 -- 172.21.15.55:0/290089965 learned_addr learned my addr 172.21.15.55:0/290089965 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:53.849 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c05c59700 1 --2- 172.21.15.55:0/290089965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c0006cbe0 0x7f1c001374f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:53.849 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c06c5b700 1 -- 172.21.15.55:0/290089965 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c0006b3f0 msgr2=0x7f1c0012e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:53.849 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c06c5b700 1 --2- 172.21.15.55:0/290089965 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c0006b3f0 0x7f1c0012e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:53.849 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c06c5b700 1 -- 172.21.15.55:0/290089965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c0006cbe0 msgr2=0x7f1c001374f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:53.849 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c06c5b700 1 --2- 172.21.15.55:0/290089965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c0006cbe0 0x7f1c001374f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:53.849 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c06c5b700 1 -- 172.21.15.55:0/290089965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf0009420 con 0x7f1c000a2d50 2023-09-30T01:55:53.849 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c06c5b700 1 --2- 172.21.15.55:0/290089965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c000a2d50 0x7f1c000a1d40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1c0006d000 tx=0x7f1bf8001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:53.850 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1bf67fc700 1 -- 172.21.15.55:0/290089965 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800a840 con 0x7f1c000a2d50 2023-09-30T01:55:53.850 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1bf67fc700 1 -- 172.21.15.55:0/290089965 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bf800a9a0 con 0x7f1c000a2d50 2023-09-30T01:55:53.850 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c0745c700 1 -- 172.21.15.55:0/290089965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c0012f120 con 0x7f1c000a2d50 2023-09-30T01:55:53.850 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1bf67fc700 1 -- 172.21.15.55:0/290089965 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bf800ad20 con 0x7f1c000a2d50 2023-09-30T01:55:53.850 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.844+0000 7f1c0745c700 1 -- 172.21.15.55:0/290089965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c00137a30 con 0x7f1c000a2d50 2023-09-30T01:55:53.850 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.848+0000 7f1c0745c700 1 -- 172.21.15.55:0/290089965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c00064440 con 0x7f1c000a2d50 2023-09-30T01:55:53.851 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.848+0000 7f1bf67fc700 1 -- 172.21.15.55:0/290089965 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f1bf8007300 con 0x7f1c000a2d50 2023-09-30T01:55:53.851 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.848+0000 7f1bf67fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:55:53.852 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.848+0000 7f1bf67fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:55:53.852 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.848+0000 7f1bf67fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:53.853 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.848+0000 7f1bf67fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:53.853 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.848+0000 7f1bf67fc700 1 --2- 172.21.15.55:0/290089965 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1be408e8e0 0x7f1be4090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:53.853 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.848+0000 7f1c0645a700 1 --2- 172.21.15.55:0/290089965 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1be408e8e0 0x7f1be4090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:53.853 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.848+0000 7f1bf67fc700 1 -- 172.21.15.55:0/290089965 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3125+0+0 (secure 0 0 0) 0x7f1bf80b46e0 con 0x7f1c000a2d50 2023-09-30T01:55:53.853 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.852+0000 7f1c0645a700 1 --2- 172.21.15.55:0/290089965 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1be408e8e0 0x7f1be4090d90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0078a0 tx=0x7f1bfc007830 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:53.859 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:53.856+0000 7f1bf67fc700 1 -- 172.21.15.55:0/290089965 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1bf8085530 con 0x7f1c000a2d50 2023-09-30T01:55:54.021 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.016+0000 7f1c0745c700 1 -- 172.21.15.55:0/290089965 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1c00147810 con 0x7f1c000a2d50 2023-09-30T01:55:54.022 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.020+0000 7f1bf67fc700 1 -- 172.21.15.55:0/290089965 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) v1 ==== 74+0+7459 (secure 0 0 0) 0x7f1bf8087460 con 0x7f1c000a2d50 2023-09-30T01:55:54.022 INFO:teuthology.misc.health.smithi055.stdout: 2023-09-30T01:55:54.022 INFO:teuthology.misc.health.smithi055.stdout:{"epoch":12,"fsid":"37496c89-c485-46e5-8550-5722d2abf46a","created":"2023-09-30T01:55:38.697831+0000","modified":"2023-09-30T01:55:51.385763+0000","last_up_change":"2023-09-30T01:55:48.191927+0000","last_in_change":"2023-09-30T01:55:39.813210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T01:55:49.090600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27634},{"type":"v1","addr":"172.21.15.55:6801","nonce":27634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27634},{"type":"v1","addr":"172.21.15.55:6803","nonce":27634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27634},{"type":"v1","addr":"172.21.15.55:6807","nonce":27634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27634},{"type":"v1","addr":"172.21.15.55:6805","nonce":27634}]},"public_addr":"172.21.15.55:6801/27634","cluster_addr":"172.21.15.55:6803/27634","heartbeat_back_addr":"172.21.15.55:6807/27634","heartbeat_front_addr":"172.21.15.55:6805/27634","state":["exists","up"]},{"osd":1,"uuid":"b52b4f6f-00aa-4ef8-b3d4-467475cd0bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":10,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":30066},{"type":"v1","addr":"172.21.15.133:6809","nonce":30066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":30066},{"type":"v1","addr":"172.21.15.133:6811","nonce":30066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":30066},{"type":"v1","addr":"172.21.15.133:6815","nonce":30066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":30066},{"type":"v1","addr":"172.21.15.133:6813","nonce":30066}]},"public_addr":"172.21.15.133:6809/30066","cluster_addr":"172.21.15.133:6811/30066","heartbeat_back_addr":"172.21.15.133:6815/30066","heartbeat_front_addr":"172.21.15.133:6813/30066","state":["exists","up"]},{"osd":2,"uuid":"c48b2c87-a33c-47fc-8b84-e64faad378b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":30068},{"type":"v1","addr":"172.21.15.133:6817","nonce":30068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":30068},{"type":"v1","addr":"172.21.15.133:6819","nonce":30068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":30068},{"type":"v1","addr":"172.21.15.133:6823","nonce":30068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":30068},{"type":"v1","addr":"172.21.15.133:6821","nonce":30068}]},"public_addr":"172.21.15.133:6817/30068","cluster_addr":"172.21.15.133:6819/30068","heartbeat_back_addr":"172.21.15.133:6823/30068","heartbeat_front_addr":"172.21.15.133:6821/30068","state":["exists","up"]},{"osd":3,"uuid":"614c2d45-f7b8-42e8-ba09-6e042a2358b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":30067},{"type":"v1","addr":"172.21.15.133:6801","nonce":30067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":30067},{"type":"v1","addr":"172.21.15.133:6803","nonce":30067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":30067},{"type":"v1","addr":"172.21.15.133:6807","nonce":30067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":30067},{"type":"v1","addr":"172.21.15.133:6805","nonce":30067}]},"public_addr":"172.21.15.133:6801/30067","cluster_addr":"172.21.15.133:6803/30067","heartbeat_back_addr":"172.21.15.133:6807/30067","heartbeat_front_addr":"172.21.15.133:6805/30067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.342817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.400384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.363652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.069618+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T01:55:54.025 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.020+0000 7f1c0745c700 10 mgrc shutdown 2023-09-30T01:55:54.025 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.020+0000 7f1c0745c700 1 -- 172.21.15.55:0/290089965 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1be408e8e0 msgr2=0x7f1be4090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:54.025 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.020+0000 7f1c0745c700 1 --2- 172.21.15.55:0/290089965 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1be408e8e0 0x7f1be4090d90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1bfc0078a0 tx=0x7f1bfc007830 comp rx=0 tx=0).stop 2023-09-30T01:55:54.025 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.020+0000 7f1c0745c700 1 -- 172.21.15.55:0/290089965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c000a2d50 msgr2=0x7f1c000a1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:54.025 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.020+0000 7f1c0745c700 1 --2- 172.21.15.55:0/290089965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c000a2d50 0x7f1c000a1d40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f1c0006d000 tx=0x7f1bf8001a20 comp rx=0 tx=0).stop 2023-09-30T01:55:54.025 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.020+0000 7f1c0745c700 1 -- 172.21.15.55:0/290089965 shutdown_connections 2023-09-30T01:55:54.025 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.020+0000 7f1c0745c700 1 --2- 172.21.15.55:0/290089965 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1c000a2d50 0x7f1c000a1d40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.025 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.020+0000 7f1c0745c700 1 --2- 172.21.15.55:0/290089965 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1c0006cbe0 0x7f1c001374f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.025 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.020+0000 7f1c0745c700 1 --2- 172.21.15.55:0/290089965 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1be408e8e0 0x7f1be4090d90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.026 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.020+0000 7f1c0745c700 1 --2- 172.21.15.55:0/290089965 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1c0006b3f0 0x7f1c0012e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.026 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.020+0000 7f1c0745c700 1 -- 172.21.15.55:0/290089965 >> 172.21.15.55:0/290089965 conn(0x7f1c000b2d90 msgr2=0x7f1c0006bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:54.026 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.020+0000 7f1c0745c700 1 -- 172.21.15.55:0/290089965 shutdown_connections 2023-09-30T01:55:54.026 INFO:teuthology.misc.health.smithi055.stderr:2023-09-30T01:55:54.020+0000 7f1c0745c700 1 -- 172.21.15.55:0/290089965 wait complete. 2023-09-30T01:55:54.036 DEBUG:teuthology.misc:4 of 4 OSDs are up 2023-09-30T01:55:54.036 INFO:tasks.ceph:Creating RBD pool 2023-09-30T01:55:54.036 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd pool create rbd 8 2023-09-30T01:55:54.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9ef5ac3700 1 Processor -- start 2023-09-30T01:55:54.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9ef5ac3700 1 -- start start 2023-09-30T01:55:54.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9ef5ac3700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ef00672d0 0x7f9ef006b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:54.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9ef5ac3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9ef00a8e60 0x7f9ef0143710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:54.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9ef5ac3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ef006c050 con 0x7f9ef0143c50 2023-09-30T01:55:54.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9ef5ac3700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef00a89d0 con 0x7f9ef00672d0 2023-09-30T01:55:54.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9ef5ac3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ef00676a0 con 0x7f9ef00a8e60 2023-09-30T01:55:54.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9eef7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ef00672d0 0x7f9ef006b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:54.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9eef7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9ef00672d0 0x7f9ef006b6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57786/0 (socket says 172.21.15.55:57786) 2023-09-30T01:55:54.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9eef7fe700 1 -- 172.21.15.55:0/217595719 learned_addr learned my addr 172.21.15.55:0/217595719 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:54.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9eeeffd700 1 --2- 172.21.15.55:0/217595719 >> v2:172.21.15.133:3300/0 conn(0x7f9ef00a8e60 0x7f9ef0143710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:54.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9eeffff700 1 --1- 172.21.15.55:0/217595719 >> v1:172.21.15.133:6789/0 conn(0x7f9ef0143c50 0x7f9ef013f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.55:59272/0 (socket says 172.21.15.55:59272) 2023-09-30T01:55:54.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9eef7fe700 1 -- 172.21.15.55:0/217595719 >> v2:172.21.15.133:3300/0 conn(0x7f9ef00a8e60 msgr2=0x7f9ef0143710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:54.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9eef7fe700 1 --2- 172.21.15.55:0/217595719 >> v2:172.21.15.133:3300/0 conn(0x7f9ef00a8e60 0x7f9ef0143710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9eef7fe700 1 -- 172.21.15.55:0/217595719 >> v1:172.21.15.133:6789/0 conn(0x7f9ef0143c50 legacy=0x7f9ef013f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:54.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.144+0000 7f9eef7fe700 1 -- 172.21.15.55:0/217595719 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef0140980 con 0x7f9ef00672d0 2023-09-30T01:55:54.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.148+0000 7f9eef7fe700 1 --2- 172.21.15.55:0/217595719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00672d0 0x7f9ef006b6e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0144840 tx=0x7f9ed8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd3cd1a2d2e99d4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:54.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.148+0000 7f9eee7fc700 1 -- 172.21.15.55:0/217595719 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8009e70 con 0x7f9ef00672d0 2023-09-30T01:55:54.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.148+0000 7f9eee7fc700 1 -- 172.21.15.55:0/217595719 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed800b860 con 0x7f9ef00672d0 2023-09-30T01:55:54.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.148+0000 7f9eee7fc700 1 -- 172.21.15.55:0/217595719 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed800bc00 con 0x7f9ef00672d0 2023-09-30T01:55:54.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.148+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/217595719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00672d0 msgr2=0x7f9ef006b6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:54.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.148+0000 7f9ef5ac3700 1 --2- 172.21.15.55:0/217595719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00672d0 0x7f9ef006b6e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9ef0144840 tx=0x7f9ed8009250 comp rx=0 tx=0).stop 2023-09-30T01:55:54.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.148+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/217595719 shutdown_connections 2023-09-30T01:55:54.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.148+0000 7f9ef5ac3700 1 --2- 172.21.15.55:0/217595719 >> v2:172.21.15.133:3300/0 conn(0x7f9ef00a8e60 0x7f9ef0143710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.148+0000 7f9ef5ac3700 1 --2- 172.21.15.55:0/217595719 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00672d0 0x7f9ef006b6e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.148+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/217595719 >> 172.21.15.55:0/217595719 conn(0x7f9ef00b45f0 msgr2=0x7f9ef00b49c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:54.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.148+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/217595719 shutdown_connections 2023-09-30T01:55:54.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.148+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/217595719 wait complete. 2023-09-30T01:55:54.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.148+0000 7f9ef5ac3700 1 Processor -- start 2023-09-30T01:55:54.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.148+0000 7f9ef5ac3700 1 -- start start 2023-09-30T01:55:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9ef5ac3700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ef00672d0 0x7f9ef011ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9ef5ac3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00a8e60 0x7f9ef0150090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9ef5ac3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ef0143c50 0x7f9ef01505d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9ef5ac3700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0150b10 con 0x7f9ef00a8e60 2023-09-30T01:55:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9ef5ac3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef0150d90 con 0x7f9ef0143c50 2023-09-30T01:55:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9ef5ac3700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ef00aecc0 con 0x7f9ef00672d0 2023-09-30T01:55:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9eef7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ef00672d0 0x7f9ef011ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9eeeffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00a8e60 0x7f9ef0150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9eef7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ef00672d0 0x7f9ef011ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56684/0 (socket says 172.21.15.55:56684) 2023-09-30T01:55:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9eef7fe700 1 -- 172.21.15.55:0/3832786735 learned_addr learned my addr 172.21.15.55:0/3832786735 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:54.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9eeffff700 1 --2- 172.21.15.55:0/3832786735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ef0143c50 0x7f9ef01505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:54.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9eef7fe700 1 -- 172.21.15.55:0/3832786735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ef0143c50 msgr2=0x7f9ef01505d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:54.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9eef7fe700 1 --2- 172.21.15.55:0/3832786735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ef0143c50 0x7f9ef01505d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9eef7fe700 1 -- 172.21.15.55:0/3832786735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00a8e60 msgr2=0x7f9ef0150090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:54.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9eef7fe700 1 --2- 172.21.15.55:0/3832786735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00a8e60 0x7f9ef0150090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9eef7fe700 1 -- 172.21.15.55:0/3832786735 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ed80094f0 con 0x7f9ef00672d0 2023-09-30T01:55:54.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9eeffff700 1 --2- 172.21.15.55:0/3832786735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ef0143c50 0x7f9ef01505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:55:54.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9eef7fe700 1 --2- 172.21.15.55:0/3832786735 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ef00672d0 0x7f9ef011ce60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00669f0 tx=0x7f9ed8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:54.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9ee77fe700 1 -- 172.21.15.55:0/3832786735 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed800b9d0 con 0x7f9ef00672d0 2023-09-30T01:55:54.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9ee77fe700 1 -- 172.21.15.55:0/3832786735 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ed800bb30 con 0x7f9ef00672d0 2023-09-30T01:55:54.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/3832786735 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ef00aee80 con 0x7f9ef00672d0 2023-09-30T01:55:54.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9ee77fe700 1 -- 172.21.15.55:0/3832786735 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ed8025650 con 0x7f9ef00672d0 2023-09-30T01:55:54.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.152+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/3832786735 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ef011d3a0 con 0x7f9ef00672d0 2023-09-30T01:55:54.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.156+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/3832786735 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ef0065180 con 0x7f9ef00672d0 2023-09-30T01:55:54.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.156+0000 7f9ee77fe700 1 -- 172.21.15.55:0/3832786735 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f9ed8023070 con 0x7f9ef00672d0 2023-09-30T01:55:54.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.156+0000 7f9ee77fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:55:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.156+0000 7f9ee77fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:55:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.156+0000 7f9ee77fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.156+0000 7f9ee77fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.156+0000 7f9ee77fe700 1 --2- 172.21.15.55:0/3832786735 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9ed008e8b0 0x7f9ed0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.156+0000 7f9eeeffd700 1 --2- 172.21.15.55:0/3832786735 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9ed008e8b0 0x7f9ed0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.156+0000 7f9ee77fe700 1 -- 172.21.15.55:0/3832786735 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 3125+0+0 (secure 0 0 0) 0x7f9ed80b5720 con 0x7f9ef00672d0 2023-09-30T01:55:54.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.156+0000 7f9eeeffd700 1 --2- 172.21.15.55:0/3832786735 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9ed008e8b0 0x7f9ed0090d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9ef013e660 tx=0x7f9ee00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:54.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.164+0000 7f9ee77fe700 1 -- 172.21.15.55:0/3832786735 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9ed8086690 con 0x7f9ef00672d0 2023-09-30T01:55:54.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.328+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/3832786735 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f9ef004b5c0 con 0x7f9ef00672d0 2023-09-30T01:55:54.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.580+0000 7f9ee77fe700 1 -- 172.21.15.55:0/3832786735 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v13) v1 ==== 109+0+0 (secure 0 0 0) 0x7f9ed8089cb0 con 0x7f9ef00672d0 2023-09-30T01:55:54.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.584+0000 7f9ef5ac3700 10 mgrc shutdown 2023-09-30T01:55:54.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.584+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/3832786735 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9ed008e8b0 msgr2=0x7f9ed0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:54.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.584+0000 7f9ef5ac3700 1 --2- 172.21.15.55:0/3832786735 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9ed008e8b0 0x7f9ed0090d60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9ef013e660 tx=0x7f9ee00091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.584+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/3832786735 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ef00672d0 msgr2=0x7f9ef011ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:54.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.584+0000 7f9ef5ac3700 1 --2- 172.21.15.55:0/3832786735 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ef00672d0 0x7f9ef011ce60 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f9ef00669f0 tx=0x7f9ed8017000 comp rx=0 tx=0).stop 2023-09-30T01:55:54.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.584+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/3832786735 shutdown_connections 2023-09-30T01:55:54.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.584+0000 7f9ef5ac3700 1 --2- 172.21.15.55:0/3832786735 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9ef0143c50 0x7f9ef01505d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.584+0000 7f9ef5ac3700 1 --2- 172.21.15.55:0/3832786735 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9ef00a8e60 0x7f9ef0150090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.584+0000 7f9ef5ac3700 1 --2- 172.21.15.55:0/3832786735 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9ed008e8b0 0x7f9ed0090d60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.584+0000 7f9ef5ac3700 1 --2- 172.21.15.55:0/3832786735 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9ef00672d0 0x7f9ef011ce60 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.584+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/3832786735 >> 172.21.15.55:0/3832786735 conn(0x7f9ef00b45f0 msgr2=0x7f9ef006ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:54.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.584+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/3832786735 shutdown_connections 2023-09-30T01:55:54.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.584+0000 7f9ef5ac3700 1 -- 172.21.15.55:0/3832786735 wait complete. 2023-09-30T01:55:54.588 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'rbd' created 2023-09-30T01:55:54.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2023-09-30T01:55:54.717 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6157fff700 1 Processor -- start 2023-09-30T01:55:54.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6157fff700 1 -- start start 2023-09-30T01:55:54.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6157fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f61580673b0 0x7f61580a7440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:54.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6157fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f61580a86c0 0x7f61580a9650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:54.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6157fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6158067780 0x7f6158141920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:54.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6157fff700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61580a7dc0 con 0x7f61580a86c0 2023-09-30T01:55:54.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6157fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61581410b0 con 0x7f6158067780 2023-09-30T01:55:54.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6157fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61580a8f50 con 0x7f61580673b0 2023-09-30T01:55:54.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f61567fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f61580a86c0 0x7f61580a9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:54.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6156ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f61580673b0 0x7f61580a7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:54.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6156ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f61580673b0 0x7f61580a7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56696/0 (socket says 172.21.15.55:56696) 2023-09-30T01:55:54.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f61567fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f61580a86c0 0x7f61580a9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57802/0 (socket says 172.21.15.55:57802) 2023-09-30T01:55:54.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6156ffd700 1 -- 172.21.15.55:0/2265604881 learned_addr learned my addr 172.21.15.55:0/2265604881 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:54.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f61577fe700 1 --2- 172.21.15.55:0/2265604881 >> v2:172.21.15.133:3300/0 conn(0x7f6158067780 0x7f6158141920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:54.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6156ffd700 1 -- 172.21.15.55:0/2265604881 >> v2:172.21.15.133:3300/0 conn(0x7f6158067780 msgr2=0x7f6158141920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:54.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6156ffd700 1 --2- 172.21.15.55:0/2265604881 >> v2:172.21.15.133:3300/0 conn(0x7f6158067780 0x7f6158141920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6156ffd700 1 -- 172.21.15.55:0/2265604881 >> v2:172.21.15.55:3300/0 conn(0x7f61580a86c0 msgr2=0x7f61580a9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:54.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6156ffd700 1 --2- 172.21.15.55:0/2265604881 >> v2:172.21.15.55:3300/0 conn(0x7f61580a86c0 0x7f61580a9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6156ffd700 1 -- 172.21.15.55:0/2265604881 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61580a7980 con 0x7f61580673b0 2023-09-30T01:55:54.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f61567fc700 1 --2- 172.21.15.55:0/2265604881 >> v2:172.21.15.55:3300/0 conn(0x7f61580a86c0 0x7f61580a9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:55:54.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6156ffd700 1 --2- 172.21.15.55:0/2265604881 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f61580673b0 0x7f61580a7440 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f61480099e0 tx=0x7f6148009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f2213d750025a90 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:54.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6155ffb700 1 -- 172.21.15.55:0/2265604881 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148011630 con 0x7f61580673b0 2023-09-30T01:55:54.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6155ffb700 1 -- 172.21.15.55:0/2265604881 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6148011790 con 0x7f61580673b0 2023-09-30T01:55:54.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6155ffb700 1 -- 172.21.15.55:0/2265604881 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6148011b30 con 0x7f61580673b0 2023-09-30T01:55:54.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6157fff700 1 -- 172.21.15.55:0/2265604881 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f61580673b0 msgr2=0x7f61580a7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:54.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.716+0000 7f6157fff700 1 --2- 172.21.15.55:0/2265604881 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f61580673b0 0x7f61580a7440 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f61480099e0 tx=0x7f6148009250 comp rx=0 tx=0).stop 2023-09-30T01:55:54.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 -- 172.21.15.55:0/2265604881 shutdown_connections 2023-09-30T01:55:54.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 --2- 172.21.15.55:0/2265604881 >> v2:172.21.15.133:3300/0 conn(0x7f6158067780 0x7f6158141920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 --2- 172.21.15.55:0/2265604881 >> v2:172.21.15.55:3300/0 conn(0x7f61580a86c0 0x7f61580a9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 --2- 172.21.15.55:0/2265604881 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f61580673b0 0x7f61580a7440 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 -- 172.21.15.55:0/2265604881 >> 172.21.15.55:0/2265604881 conn(0x7f6158062c70 msgr2=0x7f6158063070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:54.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 -- 172.21.15.55:0/2265604881 shutdown_connections 2023-09-30T01:55:54.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 -- 172.21.15.55:0/2265604881 wait complete. 2023-09-30T01:55:54.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 Processor -- start 2023-09-30T01:55:54.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 -- start start 2023-09-30T01:55:54.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61580673b0 0x7f6158153630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:54.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6158067780 0x7f615806a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:54.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61580a86c0 0x7f615811d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:54.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61581391f0 con 0x7f61580673b0 2023-09-30T01:55:54.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f615806aed0 con 0x7f61580a86c0 2023-09-30T01:55:54.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6157fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f615806b170 con 0x7f6158067780 2023-09-30T01:55:54.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f61567fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6158067780 0x7f615806a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:54.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f61567fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6158067780 0x7f615806a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56708/0 (socket says 172.21.15.55:56708) 2023-09-30T01:55:54.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f61567fc700 1 -- 172.21.15.55:0/3840829775 learned_addr learned my addr 172.21.15.55:0/3840829775 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:54.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f6156ffd700 1 --2- 172.21.15.55:0/3840829775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61580673b0 0x7f6158153630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:54.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.720+0000 7f61577fe700 1 --2- 172.21.15.55:0/3840829775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61580a86c0 0x7f615811d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:54.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.724+0000 7f61567fc700 1 -- 172.21.15.55:0/3840829775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61580a86c0 msgr2=0x7f615811d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:54.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.724+0000 7f61567fc700 1 --2- 172.21.15.55:0/3840829775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61580a86c0 0x7f615811d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.724+0000 7f61567fc700 1 -- 172.21.15.55:0/3840829775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61580673b0 msgr2=0x7f6158153630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:54.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.724+0000 7f61567fc700 1 --2- 172.21.15.55:0/3840829775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61580673b0 0x7f6158153630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:54.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.724+0000 7f61567fc700 1 -- 172.21.15.55:0/3840829775 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f614c009420 con 0x7f6158067780 2023-09-30T01:55:54.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.724+0000 7f61567fc700 1 --2- 172.21.15.55:0/3840829775 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6158067780 0x7f615806a610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f614c00ecb0 tx=0x7f614c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:54.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.724+0000 7f613effd700 1 -- 172.21.15.55:0/3840829775 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c00c920 con 0x7f6158067780 2023-09-30T01:55:54.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.724+0000 7f613effd700 1 -- 172.21.15.55:0/3840829775 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f614c00ca80 con 0x7f6158067780 2023-09-30T01:55:54.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.724+0000 7f6157fff700 1 -- 172.21.15.55:0/3840829775 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61480094f0 con 0x7f6158067780 2023-09-30T01:55:54.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.724+0000 7f613effd700 1 -- 172.21.15.55:0/3840829775 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f614c00ce00 con 0x7f6158067780 2023-09-30T01:55:54.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.724+0000 7f6157fff700 1 -- 172.21.15.55:0/3840829775 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6158153ea0 con 0x7f6158067780 2023-09-30T01:55:54.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.724+0000 7f6157fff700 1 -- 172.21.15.55:0/3840829775 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6158064440 con 0x7f6158067780 2023-09-30T01:55:54.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.728+0000 7f613effd700 1 -- 172.21.15.55:0/3840829775 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f614c013680 con 0x7f6158067780 2023-09-30T01:55:54.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.728+0000 7f613effd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:55:54.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.728+0000 7f613effd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:55:54.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.728+0000 7f613effd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:54.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.728+0000 7f613effd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:54.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.728+0000 7f613effd700 1 --2- 172.21.15.55:0/3840829775 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f614408e8b0 0x7f6144090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:54.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.728+0000 7f6156ffd700 1 --2- 172.21.15.55:0/3840829775 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f614408e8b0 0x7f6144090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:54.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.728+0000 7f613effd700 1 -- 172.21.15.55:0/3840829775 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 3467+0+0 (secure 0 0 0) 0x7f614c0b47d0 con 0x7f6158067780 2023-09-30T01:55:54.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.728+0000 7f6156ffd700 1 --2- 172.21.15.55:0/3840829775 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f614408e8b0 0x7f6144090d60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f61480099e0 tx=0x7f6148017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:54.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.740+0000 7f613effd700 1 -- 172.21.15.55:0/3840829775 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f614c085560 con 0x7f6158067780 2023-09-30T01:55:54.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:54.900+0000 7f6157fff700 1 -- 172.21.15.55:0/3840829775 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f61581412a0 con 0x7f6158067780 2023-09-30T01:55:55.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.588+0000 7f613effd700 1 -- 172.21.15.55:0/3840829775 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v14) v1 ==== 173+0+0 (secure 0 0 0) 0x7f614c021020 con 0x7f6158067780 2023-09-30T01:55:55.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.592+0000 7f6157fff700 10 mgrc shutdown 2023-09-30T01:55:55.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.592+0000 7f6157fff700 1 -- 172.21.15.55:0/3840829775 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f614408e8b0 msgr2=0x7f6144090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:55.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.592+0000 7f6157fff700 1 --2- 172.21.15.55:0/3840829775 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f614408e8b0 0x7f6144090d60 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f61480099e0 tx=0x7f6148017000 comp rx=0 tx=0).stop 2023-09-30T01:55:55.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.592+0000 7f6157fff700 1 -- 172.21.15.55:0/3840829775 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6158067780 msgr2=0x7f615806a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:55.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.592+0000 7f6157fff700 1 --2- 172.21.15.55:0/3840829775 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6158067780 0x7f615806a610 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f614c00ecb0 tx=0x7f614c0091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:55.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.592+0000 7f6157fff700 1 -- 172.21.15.55:0/3840829775 shutdown_connections 2023-09-30T01:55:55.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.592+0000 7f6157fff700 1 --2- 172.21.15.55:0/3840829775 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f61580a86c0 0x7f615811d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:55.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.592+0000 7f6157fff700 1 --2- 172.21.15.55:0/3840829775 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f614408e8b0 0x7f6144090d60 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:55.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.592+0000 7f6157fff700 1 --2- 172.21.15.55:0/3840829775 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6158067780 0x7f615806a610 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:55.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.592+0000 7f6157fff700 1 --2- 172.21.15.55:0/3840829775 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f61580673b0 0x7f6158153630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:55.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.592+0000 7f6157fff700 1 -- 172.21.15.55:0/3840829775 >> 172.21.15.55:0/3840829775 conn(0x7f6158062c70 msgr2=0x7f61580b43f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:55.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.592+0000 7f6157fff700 1 -- 172.21.15.55:0/3840829775 shutdown_connections 2023-09-30T01:55:55.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.592+0000 7f6157fff700 1 -- 172.21.15.55:0/3840829775 wait complete. 2023-09-30T01:55:55.596 INFO:teuthology.orchestra.run.smithi055.stderr:enabled application 'rbd' on pool 'rbd' 2023-09-30T01:55:55.611 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-09-30T01:55:55.611 INFO:tasks.ceph.mds.a:Restarting daemon 2023-09-30T01:55:55.611 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-09-30T01:55:55.613 INFO:tasks.ceph.mds.a:Started 2023-09-30T01:55:55.613 INFO:tasks.ceph.mds.c:Restarting daemon 2023-09-30T01:55:55.613 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-09-30T01:55:55.615 INFO:tasks.ceph.mds.c:Started 2023-09-30T01:55:55.616 INFO:tasks.ceph.mds.b:Restarting daemon 2023-09-30T01:55:55.616 DEBUG:teuthology.orchestra.run.smithi133:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-09-30T01:55:55.618 INFO:tasks.ceph.mds.b:Started 2023-09-30T01:55:55.618 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-09-30T01:55:55.619 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T01:55:55.691 INFO:tasks.ceph.mds.c.smithi055.stdout:starting mds.c at 2023-09-30T01:55:55.696 INFO:tasks.ceph.mds.b.smithi133.stdout:starting mds.b at 2023-09-30T01:55:55.697 INFO:tasks.ceph.mds.a.smithi055.stdout:starting mds.a at 2023-09-30T01:55:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f0834c71700 1 Processor -- start 2023-09-30T01:55:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f0834c71700 1 -- start start 2023-09-30T01:55:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f0834c71700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f083013c8a0 0x7f08300a5c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f0834c71700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0830068730 con 0x7f083006db40 2023-09-30T01:55:55.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f0834c71700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0830070520 con 0x7f0830070150 2023-09-30T01:55:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f0834c71700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f083006c1f0 con 0x7f083013c8a0 2023-09-30T01:55:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f0827fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f083006db40 0x7f083013c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60152/0 (socket says 172.21.15.55:60152) 2023-09-30T01:55:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f0827fff700 1 -- 172.21.15.55:0/491592378 learned_addr learned my addr 172.21.15.55:0/491592378 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:55:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f082ffff700 1 --2- 172.21.15.55:0/491592378 >> v2:172.21.15.133:3300/0 conn(0x7f083013c8a0 0x7f08300a5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f082effd700 1 -- 172.21.15.55:0/491592378 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1675380710 0 0) 0x7f0830068730 con 0x7f083006db40 2023-09-30T01:55:55.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f082effd700 1 -- 172.21.15.55:0/491592378 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f081c003570 con 0x7f083006db40 2023-09-30T01:55:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f082ffff700 1 -- 172.21.15.55:0/491592378 >> v1:172.21.15.133:6789/0 conn(0x7f0830070150 legacy=0x7f083006ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f082ffff700 1 -- 172.21.15.55:0/491592378 >> v1:172.21.15.55:6789/0 conn(0x7f083006db40 legacy=0x7f083013c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f082ffff700 1 -- 172.21.15.55:0/491592378 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f083006c4b0 con 0x7f083013c8a0 2023-09-30T01:55:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f082ffff700 1 --2- 172.21.15.55:0/491592378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f083013c8a0 0x7f08300a5c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0828009e60 tx=0x7f0828009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=101898593d153c6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f082effd700 1 -- 172.21.15.55:0/491592378 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f082800bb60 con 0x7f083013c8a0 2023-09-30T01:55:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f082effd700 1 -- 172.21.15.55:0/491592378 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f082800bcc0 con 0x7f083013c8a0 2023-09-30T01:55:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.724+0000 7f082effd700 1 -- 172.21.15.55:0/491592378 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08280116b0 con 0x7f083013c8a0 2023-09-30T01:55:55.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 -- 172.21.15.55:0/491592378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f083013c8a0 msgr2=0x7f08300a5c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 --2- 172.21.15.55:0/491592378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f083013c8a0 0x7f08300a5c90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0828009e60 tx=0x7f0828009780 comp rx=0 tx=0).stop 2023-09-30T01:55:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 -- 172.21.15.55:0/491592378 shutdown_connections 2023-09-30T01:55:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 --2- 172.21.15.55:0/491592378 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f083013c8a0 0x7f08300a5c90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 -- 172.21.15.55:0/491592378 >> 172.21.15.55:0/491592378 conn(0x7f08300b2cf0 msgr2=0x7f08300b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 -- 172.21.15.55:0/491592378 shutdown_connections 2023-09-30T01:55:55.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 -- 172.21.15.55:0/491592378 wait complete. 2023-09-30T01:55:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 Processor -- start 2023-09-30T01:55:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 -- start start 2023-09-30T01:55:55.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f083006db40 0x7f08300aa140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:55.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0830070150 0x7f08300b19b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:55.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f083013c8a0 0x7f0830136c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:55.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f083013baa0 con 0x7f0830070150 2023-09-30T01:55:55.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08300aa680 con 0x7f083013c8a0 2023-09-30T01:55:55.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0834c71700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0830135950 con 0x7f083006db40 2023-09-30T01:55:55.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f082f7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f083006db40 0x7f08300aa140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:55.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f0827fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0830070150 0x7f08300b19b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:55.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f082f7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f083006db40 0x7f08300aa140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56738/0 (socket says 172.21.15.55:56738) 2023-09-30T01:55:55.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.728+0000 7f082f7fe700 1 -- 172.21.15.55:0/3934762262 learned_addr learned my addr 172.21.15.55:0/3934762262 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:55.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f082ffff700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f083013c8a0 0x7f0830136c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:55.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f0827fff700 1 -- 172.21.15.55:0/3934762262 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f083006db40 msgr2=0x7f08300aa140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:55.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f0827fff700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f083006db40 0x7f08300aa140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:55.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f0827fff700 1 -- 172.21.15.55:0/3934762262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f083013c8a0 msgr2=0x7f0830136c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:55.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f0827fff700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f083013c8a0 0x7f0830136c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:55.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f0827fff700 1 -- 172.21.15.55:0/3934762262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0828009a20 con 0x7f0830070150 2023-09-30T01:55:55.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f082ffff700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f083013c8a0 0x7f0830136c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:55:55.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f082f7fe700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f083006db40 0x7f08300aa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:55:55.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f0827fff700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0830070150 0x7f08300b19b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f08300b09b0 tx=0x7f0818007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:55.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f08277fe700 1 -- 172.21.15.55:0/3934762262 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818005c00 con 0x7f0830070150 2023-09-30T01:55:55.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f08277fe700 1 -- 172.21.15.55:0/3934762262 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0818005d80 con 0x7f0830070150 2023-09-30T01:55:55.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f08277fe700 1 -- 172.21.15.55:0/3934762262 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0818007320 con 0x7f0830070150 2023-09-30T01:55:55.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f0834c71700 1 -- 172.21.15.55:0/3934762262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0830135c10 con 0x7f0830070150 2023-09-30T01:55:55.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f0834c71700 1 -- 172.21.15.55:0/3934762262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0830137170 con 0x7f0830070150 2023-09-30T01:55:55.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.732+0000 7f0834c71700 1 -- 172.21.15.55:0/3934762262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0830136950 con 0x7f0830070150 2023-09-30T01:55:55.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.736+0000 7f08277fe700 1 -- 172.21.15.55:0/3934762262 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f081801b3b0 con 0x7f0830070150 2023-09-30T01:55:55.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.736+0000 7f08277fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:55:55.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.736+0000 7f08277fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:55:55.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.736+0000 7f08277fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:55.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.736+0000 7f08277fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:55.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.736+0000 7f08277fe700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f081008e930 0x7f0810090de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:55.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.736+0000 7f082f7fe700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f081008e930 0x7f0810090de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:55.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.736+0000 7f08277fe700 1 -- 172.21.15.55:0/3934762262 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f08180b3a40 con 0x7f0830070150 2023-09-30T01:55:55.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.736+0000 7f082f7fe700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f081008e930 0x7f0810090de0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0820001e50 tx=0x7f0820009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:55.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.744+0000 7f08277fe700 1 -- 172.21.15.55:0/3934762262 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0830136950 con 0x7f0830070150 2023-09-30T01:55:55.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.904+0000 7f0834c71700 1 -- 172.21.15.55:0/3934762262 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0830136950 con 0x7f0830070150 2023-09-30T01:55:55.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.908+0000 7f08277fe700 1 -- 172.21.15.55:0/3934762262 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+8990 (secure 0 0 0) 0x7f0830136950 con 0x7f0830070150 2023-09-30T01:55:55.910 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:55.910 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":14,"fsid":"37496c89-c485-46e5-8550-5722d2abf46a","created":"2023-09-30T01:55:38.697831+0000","modified":"2023-09-30T01:55:55.568100+0000","last_up_change":"2023-09-30T01:55:48.191927+0000","last_in_change":"2023-09-30T01:55:39.813210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T01:55:49.090600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T01:55:54.370944+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27634},{"type":"v1","addr":"172.21.15.55:6801","nonce":27634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27634},{"type":"v1","addr":"172.21.15.55:6803","nonce":27634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27634},{"type":"v1","addr":"172.21.15.55:6807","nonce":27634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27634},{"type":"v1","addr":"172.21.15.55:6805","nonce":27634}]},"public_addr":"172.21.15.55:6801/27634","cluster_addr":"172.21.15.55:6803/27634","heartbeat_back_addr":"172.21.15.55:6807/27634","heartbeat_front_addr":"172.21.15.55:6805/27634","state":["exists","up"]},{"osd":1,"uuid":"b52b4f6f-00aa-4ef8-b3d4-467475cd0bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":30066},{"type":"v1","addr":"172.21.15.133:6809","nonce":30066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":30066},{"type":"v1","addr":"172.21.15.133:6811","nonce":30066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":30066},{"type":"v1","addr":"172.21.15.133:6815","nonce":30066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":30066},{"type":"v1","addr":"172.21.15.133:6813","nonce":30066}]},"public_addr":"172.21.15.133:6809/30066","cluster_addr":"172.21.15.133:6811/30066","heartbeat_back_addr":"172.21.15.133:6815/30066","heartbeat_front_addr":"172.21.15.133:6813/30066","state":["exists","up"]},{"osd":2,"uuid":"c48b2c87-a33c-47fc-8b84-e64faad378b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":30068},{"type":"v1","addr":"172.21.15.133:6817","nonce":30068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":30068},{"type":"v1","addr":"172.21.15.133:6819","nonce":30068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":30068},{"type":"v1","addr":"172.21.15.133:6823","nonce":30068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":30068},{"type":"v1","addr":"172.21.15.133:6821","nonce":30068}]},"public_addr":"172.21.15.133:6817/30068","cluster_addr":"172.21.15.133:6819/30068","heartbeat_back_addr":"172.21.15.133:6823/30068","heartbeat_front_addr":"172.21.15.133:6821/30068","state":["exists","up"]},{"osd":3,"uuid":"614c2d45-f7b8-42e8-ba09-6e042a2358b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":30067},{"type":"v1","addr":"172.21.15.133:6801","nonce":30067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":30067},{"type":"v1","addr":"172.21.15.133:6803","nonce":30067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":30067},{"type":"v1","addr":"172.21.15.133:6807","nonce":30067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":30067},{"type":"v1","addr":"172.21.15.133:6805","nonce":30067}]},"public_addr":"172.21.15.133:6801/30067","cluster_addr":"172.21.15.133:6803/30067","heartbeat_back_addr":"172.21.15.133:6807/30067","heartbeat_front_addr":"172.21.15.133:6805/30067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.342817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.400384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.363652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.069618+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T01:55:55.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.908+0000 7f0834c71700 10 mgrc shutdown 2023-09-30T01:55:55.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.908+0000 7f0834c71700 1 -- 172.21.15.55:0/3934762262 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f081008e930 msgr2=0x7f0810090de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:55.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.908+0000 7f0834c71700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f081008e930 0x7f0810090de0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f0820001e50 tx=0x7f0820009040 comp rx=0 tx=0).stop 2023-09-30T01:55:55.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.908+0000 7f0834c71700 1 -- 172.21.15.55:0/3934762262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0830070150 msgr2=0x7f08300b19b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:55.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.908+0000 7f0834c71700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0830070150 0x7f08300b19b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f08300b09b0 tx=0x7f0818007d50 comp rx=0 tx=0).stop 2023-09-30T01:55:55.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.908+0000 7f0834c71700 1 -- 172.21.15.55:0/3934762262 shutdown_connections 2023-09-30T01:55:55.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.908+0000 7f0834c71700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f083013c8a0 0x7f0830136c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:55.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.908+0000 7f0834c71700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0830070150 0x7f08300b19b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:55.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.908+0000 7f0834c71700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f081008e930 0x7f0810090de0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:55.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.908+0000 7f0834c71700 1 --2- 172.21.15.55:0/3934762262 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f083006db40 0x7f08300aa140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:55.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.908+0000 7f0834c71700 1 -- 172.21.15.55:0/3934762262 >> 172.21.15.55:0/3934762262 conn(0x7f08300b2cf0 msgr2=0x7f083006ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:55.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.908+0000 7f0834c71700 1 -- 172.21.15.55:0/3934762262 shutdown_connections 2023-09-30T01:55:55.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:55.908+0000 7f0834c71700 1 -- 172.21.15.55:0/3934762262 wait complete. 2023-09-30T01:55:55.928 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T01:55:49.090600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T01:55:54.370944+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T01:55:55.929 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T01:55:56.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.040+0000 7fcdb49b2700 1 Processor -- start 2023-09-30T01:55:56.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.040+0000 7fcdb49b2700 1 -- start start 2023-09-30T01:55:56.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.040+0000 7fcdb49b2700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcdb0067470 0x7fcdb006b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.040+0000 7fcdb49b2700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdb0136750 0x7fcdb006b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.040+0000 7fcdb49b2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdb00a8e00 con 0x7fcdb00670a0 2023-09-30T01:55:56.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.040+0000 7fcdb49b2700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdb006b070 con 0x7fcdb0067470 2023-09-30T01:55:56.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.040+0000 7fcdb49b2700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00a9290 con 0x7fcdb0136750 2023-09-30T01:55:56.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.040+0000 7fcdae59c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcdb0067470 0x7fcdb006b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.040+0000 7fcdaf59e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdb0136750 0x7fcdb006b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdae59c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcdb0067470 0x7fcdb006b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57862/0 (socket says 172.21.15.55:57862) 2023-09-30T01:55:56.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdaf59e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdb0136750 0x7fcdb006b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56744/0 (socket says 172.21.15.55:56744) 2023-09-30T01:55:56.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdae59c700 1 -- 172.21.15.55:0/4280656980 learned_addr learned my addr 172.21.15.55:0/4280656980 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:56.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdaf59e700 1 -- 172.21.15.55:0/4280656980 >> v2:172.21.15.55:3300/0 conn(0x7fcdb0067470 msgr2=0x7fcdb006b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:56.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdaf59e700 1 --2- 172.21.15.55:0/4280656980 >> v2:172.21.15.55:3300/0 conn(0x7fcdb0067470 0x7fcdb006b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdaf59e700 1 -- 172.21.15.55:0/4280656980 >> v1:172.21.15.133:6789/0 conn(0x7fcdb00670a0 legacy=0x7fcdb006a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdaf59e700 1 -- 172.21.15.55:0/4280656980 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb006ad20 con 0x7fcdb0136750 2023-09-30T01:55:56.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdaf59e700 1 --2- 172.21.15.55:0/4280656980 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdb0136750 0x7fcdb006b870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009e60 tx=0x7fcda8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bea10bef03ab90d0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:56.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdadd9b700 1 -- 172.21.15.55:0/4280656980 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda800e070 con 0x7fcdb0136750 2023-09-30T01:55:56.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdadd9b700 1 -- 172.21.15.55:0/4280656980 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcda800bb60 con 0x7fcdb0136750 2023-09-30T01:55:56.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdadd9b700 1 -- 172.21.15.55:0/4280656980 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcda8012430 con 0x7fcdb0136750 2023-09-30T01:55:56.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdb49b2700 1 -- 172.21.15.55:0/4280656980 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdb0136750 msgr2=0x7fcdb006b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdb49b2700 1 --2- 172.21.15.55:0/4280656980 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdb0136750 0x7fcdb006b870 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fcda8009e60 tx=0x7fcda8009780 comp rx=0 tx=0).stop 2023-09-30T01:55:56.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdb49b2700 1 -- 172.21.15.55:0/4280656980 shutdown_connections 2023-09-30T01:55:56.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdb49b2700 1 --2- 172.21.15.55:0/4280656980 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdb0136750 0x7fcdb006b870 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdb49b2700 1 --2- 172.21.15.55:0/4280656980 >> v2:172.21.15.55:3300/0 conn(0x7fcdb0067470 0x7fcdb006b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdb49b2700 1 -- 172.21.15.55:0/4280656980 >> 172.21.15.55:0/4280656980 conn(0x7fcdb00b4530 msgr2=0x7fcdb00b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:56.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdb49b2700 1 -- 172.21.15.55:0/4280656980 shutdown_connections 2023-09-30T01:55:56.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdb49b2700 1 -- 172.21.15.55:0/4280656980 wait complete. 2023-09-30T01:55:56.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdb49b2700 1 Processor -- start 2023-09-30T01:55:56.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.044+0000 7fcdb49b2700 1 -- start start 2023-09-30T01:55:56.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdb49b2700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdb00670a0 0x7fcdb0135540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdb49b2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdb0067470 0x7fcdb00ac470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdb49b2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdb0136750 0x7fcdb00aa980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdb49b2700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb0146810 con 0x7fcdb0067470 2023-09-30T01:55:56.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdb49b2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00ab990 con 0x7fcdb0136750 2023-09-30T01:55:56.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdb49b2700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb00abb90 con 0x7fcdb00670a0 2023-09-30T01:55:56.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdae59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdb0067470 0x7fcdb00ac470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdaed9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdb00670a0 0x7fcdb0135540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdae59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdb0067470 0x7fcdb00ac470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57878/0 (socket says 172.21.15.55:57878) 2023-09-30T01:55:56.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdae59c700 1 -- 172.21.15.55:0/3343410028 learned_addr learned my addr 172.21.15.55:0/3343410028 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:56.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdaf59e700 1 --2- 172.21.15.55:0/3343410028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdb0136750 0x7fcdb00aa980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdaed9d700 1 -- 172.21.15.55:0/3343410028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdb0136750 msgr2=0x7fcdb00aa980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdaed9d700 1 --2- 172.21.15.55:0/3343410028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdb0136750 0x7fcdb00aa980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdaed9d700 1 -- 172.21.15.55:0/3343410028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdb0067470 msgr2=0x7fcdb00ac470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdaed9d700 1 --2- 172.21.15.55:0/3343410028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdb0067470 0x7fcdb00ac470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdaed9d700 1 -- 172.21.15.55:0/3343410028 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda8009a20 con 0x7fcdb00670a0 2023-09-30T01:55:56.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdae59c700 1 --2- 172.21.15.55:0/3343410028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdb0067470 0x7fcdb00ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:55:56.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdaed9d700 1 --2- 172.21.15.55:0/3343410028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdb00670a0 0x7fcdb0135540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800c590 tx=0x7fcd98007eb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:56.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcda6ffd700 1 -- 172.21.15.55:0/3343410028 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98011590 con 0x7fcdb00670a0 2023-09-30T01:55:56.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcda6ffd700 1 -- 172.21.15.55:0/3343410028 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd98011710 con 0x7fcdb00670a0 2023-09-30T01:55:56.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdb49b2700 1 -- 172.21.15.55:0/3343410028 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb012d5c0 con 0x7fcdb00670a0 2023-09-30T01:55:56.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcda6ffd700 1 -- 172.21.15.55:0/3343410028 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd98011ad0 con 0x7fcdb00670a0 2023-09-30T01:55:56.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.048+0000 7fcdb49b2700 1 -- 172.21.15.55:0/3343410028 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb012db00 con 0x7fcdb00670a0 2023-09-30T01:55:56.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.052+0000 7fcdb49b2700 1 -- 172.21.15.55:0/3343410028 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb0064440 con 0x7fcdb00670a0 2023-09-30T01:55:56.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.052+0000 7fcda6ffd700 1 -- 172.21.15.55:0/3343410028 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fcd9801b3b0 con 0x7fcdb00670a0 2023-09-30T01:55:56.057 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.052+0000 7fcda6ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:55:56.058 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.056+0000 7fcda6ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:55:56.059 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.056+0000 7fcda6ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:56.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.056+0000 7fcda6ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:56.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.056+0000 7fcda6ffd700 1 --2- 172.21.15.55:0/3343410028 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcd9008e8b0 0x7fcd90090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.056+0000 7fcda6ffd700 1 -- 172.21.15.55:0/3343410028 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fcd980b3b40 con 0x7fcdb00670a0 2023-09-30T01:55:56.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.056+0000 7fcdae59c700 1 --2- 172.21.15.55:0/3343410028 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcd9008e8b0 0x7fcd90090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.060 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.056+0000 7fcdae59c700 1 --2- 172.21.15.55:0/3343410028 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcd9008e8b0 0x7fcd90090d60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcdb006ac60 tx=0x7fcda0009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:56.062 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.060+0000 7fcda6ffd700 1 -- 172.21.15.55:0/3343410028 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcd98084950 con 0x7fcdb00670a0 2023-09-30T01:55:56.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.224+0000 7fcdb49b2700 1 -- 172.21.15.55:0/3343410028 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcdb00a88d0 con 0x7fcdb00670a0 2023-09-30T01:55:56.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.224+0000 7fcda6ffd700 1 -- 172.21.15.55:0/3343410028 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v14) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd980170a0 con 0x7fcdb00670a0 2023-09-30T01:55:56.229 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-09-30T01:55:56.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.228+0000 7fcdb49b2700 10 mgrc shutdown 2023-09-30T01:55:56.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.228+0000 7fcdb49b2700 1 -- 172.21.15.55:0/3343410028 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcd9008e8b0 msgr2=0x7fcd90090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.228+0000 7fcdb49b2700 1 --2- 172.21.15.55:0/3343410028 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcd9008e8b0 0x7fcd90090d60 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fcdb006ac60 tx=0x7fcda0009250 comp rx=0 tx=0).stop 2023-09-30T01:55:56.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.228+0000 7fcdb49b2700 1 -- 172.21.15.55:0/3343410028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdb00670a0 msgr2=0x7fcdb0135540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.228+0000 7fcdb49b2700 1 --2- 172.21.15.55:0/3343410028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdb00670a0 0x7fcdb0135540 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fcd9800c590 tx=0x7fcd98007eb0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.228+0000 7fcdb49b2700 1 -- 172.21.15.55:0/3343410028 shutdown_connections 2023-09-30T01:55:56.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.228+0000 7fcdb49b2700 1 --2- 172.21.15.55:0/3343410028 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdb0136750 0x7fcdb00aa980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.228+0000 7fcdb49b2700 1 --2- 172.21.15.55:0/3343410028 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdb0067470 0x7fcdb00ac470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.228+0000 7fcdb49b2700 1 --2- 172.21.15.55:0/3343410028 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcd9008e8b0 0x7fcd90090d60 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.228+0000 7fcdb49b2700 1 --2- 172.21.15.55:0/3343410028 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdb00670a0 0x7fcdb0135540 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.228+0000 7fcdb49b2700 1 -- 172.21.15.55:0/3343410028 >> 172.21.15.55:0/3343410028 conn(0x7fcdb00b4530 msgr2=0x7fcdb00b4a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:56.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.228+0000 7fcdb49b2700 1 -- 172.21.15.55:0/3343410028 shutdown_connections 2023-09-30T01:55:56.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.228+0000 7fcdb49b2700 1 -- 172.21.15.55:0/3343410028 wait complete. 2023-09-30T01:55:56.248 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T01:55:56.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.360+0000 7f3903fff700 1 Processor -- start 2023-09-30T01:55:56.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.360+0000 7f3903fff700 1 -- start start 2023-09-30T01:55:56.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.360+0000 7f3903fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39040672d0 0x7f39040a5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.360+0000 7f3903fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f39040a8570 0x7f390414a910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.360+0000 7f3903fff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3904140fd0 con 0x7f39040a3780 2023-09-30T01:55:56.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.360+0000 7f3903fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39040a5a60 con 0x7f39040a8570 2023-09-30T01:55:56.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.360+0000 7f3903fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39040676a0 con 0x7f39040672d0 2023-09-30T01:55:56.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.360+0000 7f3902ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39040672d0 0x7f39040a5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.360+0000 7f38fa7fc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f39040a3780 0x7f39041408c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60162/0 (socket says 172.21.15.55:60162) 2023-09-30T01:55:56.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.360+0000 7f38fa7fc700 1 -- 172.21.15.55:0/1452324623 learned_addr learned my addr 172.21.15.55:0/1452324623 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:55:56.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.360+0000 7f39037fe700 1 --2- 172.21.15.55:0/1452324623 >> v2:172.21.15.133:3300/0 conn(0x7f39040a8570 0x7f390414a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.360+0000 7f3902ffd700 1 -- 172.21.15.55:0/1452324623 >> v2:172.21.15.133:3300/0 conn(0x7f39040a8570 msgr2=0x7f390414a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:56.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.360+0000 7f3902ffd700 1 --2- 172.21.15.55:0/1452324623 >> v2:172.21.15.133:3300/0 conn(0x7f39040a8570 0x7f390414a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3902ffd700 1 -- 172.21.15.55:0/1452324623 >> v1:172.21.15.55:6789/0 conn(0x7f39040a3780 legacy=0x7f39041408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.360+0000 7f39027fc700 1 -- 172.21.15.55:0/1452324623 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253339699 0 0) 0x7f3904140fd0 con 0x7f39040a3780 2023-09-30T01:55:56.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3902ffd700 1 -- 172.21.15.55:0/1452324623 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39040a8b40 con 0x7f39040672d0 2023-09-30T01:55:56.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3902ffd700 1 --2- 172.21.15.55:0/1452324623 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39040672d0 0x7f39040a5520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f38f40098e0 tx=0x7f38f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c40548b95dc731a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:56.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f39027fc700 1 -- 172.21.15.55:0/1452324623 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4009e80 con 0x7f39040672d0 2023-09-30T01:55:56.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f39027fc700 1 -- 172.21.15.55:0/1452324623 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f400b8f0 con 0x7f39040672d0 2023-09-30T01:55:56.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f39027fc700 1 -- 172.21.15.55:0/1452324623 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f400bc70 con 0x7f39040672d0 2023-09-30T01:55:56.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 -- 172.21.15.55:0/1452324623 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39040672d0 msgr2=0x7f39040a5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 --2- 172.21.15.55:0/1452324623 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39040672d0 0x7f39040a5520 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f38f40098e0 tx=0x7f38f40091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 -- 172.21.15.55:0/1452324623 shutdown_connections 2023-09-30T01:55:56.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 --2- 172.21.15.55:0/1452324623 >> v2:172.21.15.133:3300/0 conn(0x7f39040a8570 0x7f390414a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 --2- 172.21.15.55:0/1452324623 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39040672d0 0x7f39040a5520 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 -- 172.21.15.55:0/1452324623 >> 172.21.15.55:0/1452324623 conn(0x7f3904062c70 msgr2=0x7f3904063070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:56.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 -- 172.21.15.55:0/1452324623 shutdown_connections 2023-09-30T01:55:56.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 -- 172.21.15.55:0/1452324623 wait complete. 2023-09-30T01:55:56.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 Processor -- start 2023-09-30T01:55:56.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 -- start start 2023-09-30T01:55:56.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39040672d0 0x7f390406d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39040a3780 0x7f390413f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39040a8570 0x7f390406c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390409a040 con 0x7f39040a3780 2023-09-30T01:55:56.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390406e0c0 con 0x7f39040a8570 2023-09-30T01:55:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.364+0000 7f3903fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3904099e60 con 0x7f39040672d0 2023-09-30T01:55:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f3902ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39040672d0 0x7f390406d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f3902ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39040672d0 0x7f390406d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56776/0 (socket says 172.21.15.55:56776) 2023-09-30T01:55:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f3902ffd700 1 -- 172.21.15.55:0/915848146 learned_addr learned my addr 172.21.15.55:0/915848146 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f38fa7fc700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39040a3780 0x7f390413f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f39037fe700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39040a8570 0x7f390406c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f3902ffd700 1 -- 172.21.15.55:0/915848146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39040a8570 msgr2=0x7f390406c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f3902ffd700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39040a8570 0x7f390406c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f3902ffd700 1 -- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39040a3780 msgr2=0x7f390413f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f3902ffd700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39040a3780 0x7f390413f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f3902ffd700 1 -- 172.21.15.55:0/915848146 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f4009420 con 0x7f39040672d0 2023-09-30T01:55:56.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f38fa7fc700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39040a3780 0x7f390413f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:55:56.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f3902ffd700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39040672d0 0x7f390406d390 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f38f400b3c0 tx=0x7f38f4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:56.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f38fb7fe700 1 -- 172.21.15.55:0/915848146 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4011420 con 0x7f39040672d0 2023-09-30T01:55:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f38fb7fe700 1 -- 172.21.15.55:0/915848146 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38f4011580 con 0x7f39040672d0 2023-09-30T01:55:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f3903fff700 1 -- 172.21.15.55:0/915848146 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39041393e0 con 0x7f39040672d0 2023-09-30T01:55:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f38fb7fe700 1 -- 172.21.15.55:0/915848146 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38f4011920 con 0x7f39040672d0 2023-09-30T01:55:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f3903fff700 1 -- 172.21.15.55:0/915848146 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3904139960 con 0x7f39040672d0 2023-09-30T01:55:56.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.368+0000 7f3903fff700 1 -- 172.21.15.55:0/915848146 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3904064440 con 0x7f39040672d0 2023-09-30T01:55:56.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.372+0000 7f38fb7fe700 1 -- 172.21.15.55:0/915848146 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f38f40253f0 con 0x7f39040672d0 2023-09-30T01:55:56.375 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.372+0000 7f38fb7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:55:56.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.372+0000 7f38fb7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:55:56.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.372+0000 7f38fb7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.372+0000 7f38fb7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.372+0000 7f38fb7fe700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f38e408e830 0x7f38e4090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.372+0000 7f38fa7fc700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f38e408e830 0x7f38e4090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.372+0000 7f38fb7fe700 1 -- 172.21.15.55:0/915848146 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f38f40b6a00 con 0x7f39040672d0 2023-09-30T01:55:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.372+0000 7f38fa7fc700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f38e408e830 0x7f38e4090ce0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f390413bab0 tx=0x7f38ec009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:56.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.376+0000 7f38fb7fe700 1 -- 172.21.15.55:0/915848146 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f38f4087810 con 0x7f39040672d0 2023-09-30T01:55:56.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.532+0000 7f3903fff700 1 -- 172.21.15.55:0/915848146 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f39040a8e00 con 0x7f39040672d0 2023-09-30T01:55:56.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.532+0000 7f38fb7fe700 1 -- 172.21.15.55:0/915848146 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v14) v1 ==== 92+0+10 (secure 0 0 0) 0x7f38f40330a0 con 0x7f39040672d0 2023-09-30T01:55:56.536 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-09-30T01:55:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.536+0000 7f3903fff700 10 mgrc shutdown 2023-09-30T01:55:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.536+0000 7f3903fff700 1 -- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f38e408e830 msgr2=0x7f38e4090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.536+0000 7f3903fff700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f38e408e830 0x7f38e4090ce0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f390413bab0 tx=0x7f38ec009040 comp rx=0 tx=0).stop 2023-09-30T01:55:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.536+0000 7f3903fff700 1 -- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39040672d0 msgr2=0x7f390406d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.536+0000 7f3903fff700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39040672d0 0x7f390406d390 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f38f400b3c0 tx=0x7f38f4017000 comp rx=0 tx=0).stop 2023-09-30T01:55:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.536+0000 7f3903fff700 1 -- 172.21.15.55:0/915848146 shutdown_connections 2023-09-30T01:55:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.536+0000 7f3903fff700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f39040a8570 0x7f390406c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.536+0000 7f3903fff700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f39040a3780 0x7f390413f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.536+0000 7f3903fff700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f38e408e830 0x7f38e4090ce0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.536+0000 7f3903fff700 1 --2- 172.21.15.55:0/915848146 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f39040672d0 0x7f390406d390 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.536+0000 7f3903fff700 1 -- 172.21.15.55:0/915848146 >> 172.21.15.55:0/915848146 conn(0x7f3904062c70 msgr2=0x7f39040b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:56.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.536+0000 7f3903fff700 1 -- 172.21.15.55:0/915848146 shutdown_connections 2023-09-30T01:55:56.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.536+0000 7f3903fff700 1 -- 172.21.15.55:0/915848146 wait complete. 2023-09-30T01:55:56.550 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T01:55:56.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 Processor -- start 2023-09-30T01:55:56.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 -- start start 2023-09-30T01:55:56.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7eb40a1150 0x7f7eb413dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7eb413e520 0x7f7eb4148400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb409f480 con 0x7f7eb40a0d80 2023-09-30T01:55:56.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb409f740 con 0x7f7eb413e520 2023-09-30T01:55:56.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eb413e9a0 con 0x7f7eb40a1150 2023-09-30T01:55:56.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb2d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7eb413e520 0x7f7eb4148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb2d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7eb413e520 0x7f7eb4148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57882/0 (socket says 172.21.15.55:57882) 2023-09-30T01:55:56.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb2d9d700 1 -- 172.21.15.55:0/3189541378 learned_addr learned my addr 172.21.15.55:0/3189541378 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:56.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb1d9b700 1 --2- 172.21.15.55:0/3189541378 >> v2:172.21.15.133:3300/0 conn(0x7f7eb40a1150 0x7f7eb413dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb2d9d700 1 -- 172.21.15.55:0/3189541378 >> v2:172.21.15.133:3300/0 conn(0x7f7eb40a1150 msgr2=0x7f7eb413dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:56.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb2d9d700 1 --2- 172.21.15.55:0/3189541378 >> v2:172.21.15.133:3300/0 conn(0x7f7eb40a1150 0x7f7eb413dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb2d9d700 1 -- 172.21.15.55:0/3189541378 >> v1:172.21.15.133:6789/0 conn(0x7f7eb40a0d80 legacy=0x7f7eb40a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:56.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb2d9d700 1 -- 172.21.15.55:0/3189541378 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb406e040 con 0x7f7eb413e520 2023-09-30T01:55:56.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb2d9d700 1 --2- 172.21.15.55:0/3189541378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eb413e520 0x7f7eb4148400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40099b0 tx=0x7f7ea4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165f2ea8ac645074 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:56.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb159a700 1 -- 172.21.15.55:0/3189541378 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea400b820 con 0x7f7eb413e520 2023-09-30T01:55:56.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb159a700 1 -- 172.21.15.55:0/3189541378 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea400b980 con 0x7f7eb413e520 2023-09-30T01:55:56.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb159a700 1 -- 172.21.15.55:0/3189541378 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea400bd20 con 0x7f7eb413e520 2023-09-30T01:55:56.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 -- 172.21.15.55:0/3189541378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eb413e520 msgr2=0x7f7eb4148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 --2- 172.21.15.55:0/3189541378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eb413e520 0x7f7eb4148400 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40099b0 tx=0x7f7ea4009250 comp rx=0 tx=0).stop 2023-09-30T01:55:56.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 -- 172.21.15.55:0/3189541378 shutdown_connections 2023-09-30T01:55:56.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 --2- 172.21.15.55:0/3189541378 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eb413e520 0x7f7eb4148400 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 --2- 172.21.15.55:0/3189541378 >> v2:172.21.15.133:3300/0 conn(0x7f7eb40a1150 0x7f7eb413dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 -- 172.21.15.55:0/3189541378 >> 172.21.15.55:0/3189541378 conn(0x7f7eb40b23d0 msgr2=0x7f7eb40b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:56.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 -- 172.21.15.55:0/3189541378 shutdown_connections 2023-09-30T01:55:56.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.656+0000 7f7eb359e700 1 -- 172.21.15.55:0/3189541378 wait complete. 2023-09-30T01:55:56.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb359e700 1 Processor -- start 2023-09-30T01:55:56.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb359e700 1 -- start start 2023-09-30T01:55:56.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb359e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7eb40a0d80 0x7f7eb4097710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb359e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eb40a1150 0x7f7eb4096430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb413e520 0x7f7eb4096970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb359e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4097380 con 0x7f7eb40a1150 2023-09-30T01:55:56.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4096eb0 con 0x7f7eb413e520 2023-09-30T01:55:56.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb359e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40970c0 con 0x7f7eb40a0d80 2023-09-30T01:55:56.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb259c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7eb40a0d80 0x7f7eb4097710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb1d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eb40a1150 0x7f7eb4096430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb1d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eb40a1150 0x7f7eb4096430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57886/0 (socket says 172.21.15.55:57886) 2023-09-30T01:55:56.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb1d9b700 1 -- 172.21.15.55:0/3196304172 learned_addr learned my addr 172.21.15.55:0/3196304172 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:56.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb259c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7eb40a0d80 0x7f7eb4097710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56788/0 (socket says 172.21.15.55:56788) 2023-09-30T01:55:56.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb2d9d700 1 --2- 172.21.15.55:0/3196304172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb413e520 0x7f7eb4096970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb259c700 1 -- 172.21.15.55:0/3196304172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb413e520 msgr2=0x7f7eb4096970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb259c700 1 --2- 172.21.15.55:0/3196304172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb413e520 0x7f7eb4096970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb259c700 1 -- 172.21.15.55:0/3196304172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eb40a1150 msgr2=0x7f7eb4096430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb259c700 1 --2- 172.21.15.55:0/3196304172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eb40a1150 0x7f7eb4096430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb259c700 1 -- 172.21.15.55:0/3196304172 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ea40094f0 con 0x7f7eb40a0d80 2023-09-30T01:55:56.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb1d9b700 1 --2- 172.21.15.55:0/3196304172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eb40a1150 0x7f7eb4096430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:55:56.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb259c700 1 --2- 172.21.15.55:0/3196304172 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7eb40a0d80 0x7f7eb4097710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00c840 tx=0x7f7eac001630 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:56.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eaa7fc700 1 -- 172.21.15.55:0/3196304172 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac012630 con 0x7f7eb40a0d80 2023-09-30T01:55:56.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eaa7fc700 1 -- 172.21.15.55:0/3196304172 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eac012790 con 0x7f7eb40a0d80 2023-09-30T01:55:56.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb359e700 1 -- 172.21.15.55:0/3196304172 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb4143c90 con 0x7f7eb40a0d80 2023-09-30T01:55:56.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eaa7fc700 1 -- 172.21.15.55:0/3196304172 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eac012b50 con 0x7f7eb40a0d80 2023-09-30T01:55:56.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.660+0000 7f7eb359e700 1 -- 172.21.15.55:0/3196304172 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb4096170 con 0x7f7eb40a0d80 2023-09-30T01:55:56.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.664+0000 7f7eb359e700 1 -- 172.21.15.55:0/3196304172 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb4064440 con 0x7f7eb40a0d80 2023-09-30T01:55:56.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.664+0000 7f7eaa7fc700 1 -- 172.21.15.55:0/3196304172 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f7eac003030 con 0x7f7eb40a0d80 2023-09-30T01:55:56.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.664+0000 7f7eaa7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:55:56.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.664+0000 7f7eaa7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:55:56.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.664+0000 7f7eaa7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:56.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.664+0000 7f7eaa7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:56.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.664+0000 7f7eaa7fc700 1 --2- 172.21.15.55:0/3196304172 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7e9408e8e0 0x7f7e94090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:56.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.664+0000 7f7eaa7fc700 1 -- 172.21.15.55:0/3196304172 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7f7eac0b4250 con 0x7f7eb40a0d80 2023-09-30T01:55:56.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.668+0000 7f7eb1d9b700 1 --2- 172.21.15.55:0/3196304172 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7e9408e8e0 0x7f7e94090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:56.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.668+0000 7f7eb1d9b700 1 --2- 172.21.15.55:0/3196304172 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7e9408e8e0 0x7f7e94090d90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7eb409fe60 tx=0x7f7e9c008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:56.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.672+0000 7f7eaa7fc700 1 -- 172.21.15.55:0/3196304172 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7eac085060 con 0x7f7eb40a0d80 2023-09-30T01:55:56.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.872+0000 7f7eb359e700 1 -- 172.21.15.55:0/3196304172 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7eb40a2240 con 0x7f7eb40a0d80 2023-09-30T01:55:56.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.876+0000 7f7eaa7fc700 1 -- 172.21.15.55:0/3196304172 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+2771 (secure 0 0 0) 0x7f7eac088680 con 0x7f7eb40a0d80 2023-09-30T01:55:56.878 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:56.878 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6811/2430010052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2430010052},{"type":"v1","addr":"172.21.15.55:6811","nonce":2430010052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4208,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6813/2133827295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2133827295},{"type":"v1","addr":"172.21.15.55:6813","nonce":2133827295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4258,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.133:6825/2206089193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2206089193},{"type":"v1","addr":"172.21.15.133:6825","nonce":2206089193}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-09-30T01:55:56.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.876+0000 7f7eb359e700 10 mgrc shutdown 2023-09-30T01:55:56.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.876+0000 7f7eb359e700 1 -- 172.21.15.55:0/3196304172 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7e9408e8e0 msgr2=0x7f7e94090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.876+0000 7f7eb359e700 1 --2- 172.21.15.55:0/3196304172 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7e9408e8e0 0x7f7e94090d90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f7eb409fe60 tx=0x7f7e9c008040 comp rx=0 tx=0).stop 2023-09-30T01:55:56.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.876+0000 7f7eb359e700 1 -- 172.21.15.55:0/3196304172 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7eb40a0d80 msgr2=0x7f7eb4097710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:56.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.876+0000 7f7eb359e700 1 --2- 172.21.15.55:0/3196304172 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7eb40a0d80 0x7f7eb4097710 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7eac00c840 tx=0x7f7eac001630 comp rx=0 tx=0).stop 2023-09-30T01:55:56.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.876+0000 7f7eb359e700 1 -- 172.21.15.55:0/3196304172 shutdown_connections 2023-09-30T01:55:56.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.876+0000 7f7eb359e700 1 --2- 172.21.15.55:0/3196304172 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7eb413e520 0x7f7eb4096970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.876+0000 7f7eb359e700 1 --2- 172.21.15.55:0/3196304172 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7eb40a1150 0x7f7eb4096430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.876+0000 7f7eb359e700 1 --2- 172.21.15.55:0/3196304172 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7e9408e8e0 0x7f7e94090d90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.876+0000 7f7eb359e700 1 --2- 172.21.15.55:0/3196304172 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7eb40a0d80 0x7f7eb4097710 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:56.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.876+0000 7f7eb359e700 1 -- 172.21.15.55:0/3196304172 >> 172.21.15.55:0/3196304172 conn(0x7f7eb40b23d0 msgr2=0x7f7eb413ef60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:56.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.876+0000 7f7eb359e700 1 -- 172.21.15.55:0/3196304172 shutdown_connections 2023-09-30T01:55:56.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.876+0000 7f7eb359e700 1 -- 172.21.15.55:0/3196304172 wait complete. 2023-09-30T01:55:56.882 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 3 2023-09-30T01:55:56.892 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T01:55:57.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.996+0000 7fab9e5e9700 1 Processor -- start 2023-09-30T01:55:57.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.996+0000 7fab9e5e9700 1 -- start start 2023-09-30T01:55:57.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.996+0000 7fab9e5e9700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab980a65f0 0x7fab9813f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.996+0000 7fab9e5e9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab98067b90 con 0x7fab980677c0 2023-09-30T01:55:57.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.996+0000 7fab9e5e9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab980a5460 con 0x7fab9813fd80 2023-09-30T01:55:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.996+0000 7fab9e5e9700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab980a9ae0 con 0x7fab980a65f0 2023-09-30T01:55:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.996+0000 7fab9cde6700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab980a65f0 0x7fab9813f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.996+0000 7fab9d5e7700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fab980677c0 0x7fab980a93d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60164/0 (socket says 172.21.15.55:60164) 2023-09-30T01:55:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:56.996+0000 7fab9d5e7700 1 -- 172.21.15.55:0/3529951769 learned_addr learned my addr 172.21.15.55:0/3529951769 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:55:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab8ffff700 1 -- 172.21.15.55:0/3529951769 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2927095043 0 0) 0x7fab98067b90 con 0x7fab980677c0 2023-09-30T01:55:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab8ffff700 1 -- 172.21.15.55:0/3529951769 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab84003570 con 0x7fab980677c0 2023-09-30T01:55:57.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab8ffff700 1 -- 172.21.15.55:0/3529951769 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 84090196 0 0) 0x7fab980a5460 con 0x7fab9813fd80 2023-09-30T01:55:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab8ffff700 1 -- 172.21.15.55:0/3529951769 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab98067b90 con 0x7fab9813fd80 2023-09-30T01:55:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab9cde6700 1 -- 172.21.15.55:0/3529951769 >> v1:172.21.15.133:6789/0 conn(0x7fab9813fd80 legacy=0x7fab9814a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab9cde6700 1 -- 172.21.15.55:0/3529951769 >> v1:172.21.15.55:6789/0 conn(0x7fab980677c0 legacy=0x7fab980a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab9cde6700 1 -- 172.21.15.55:0/3529951769 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab980a5720 con 0x7fab980a65f0 2023-09-30T01:55:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab9cde6700 1 --2- 172.21.15.55:0/3529951769 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab980a65f0 0x7fab9813f840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fab94009e90 tx=0x7fab94009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f64b15569da33d46 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab8ffff700 1 -- 172.21.15.55:0/3529951769 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9400e070 con 0x7fab980a65f0 2023-09-30T01:55:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab8ffff700 1 -- 172.21.15.55:0/3529951769 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9400bb40 con 0x7fab980a65f0 2023-09-30T01:55:57.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab8ffff700 1 -- 172.21.15.55:0/3529951769 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94012430 con 0x7fab980a65f0 2023-09-30T01:55:57.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3529951769 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab980a65f0 msgr2=0x7fab9813f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab9e5e9700 1 --2- 172.21.15.55:0/3529951769 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab980a65f0 0x7fab9813f840 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fab94009e90 tx=0x7fab94009780 comp rx=0 tx=0).stop 2023-09-30T01:55:57.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3529951769 shutdown_connections 2023-09-30T01:55:57.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab9e5e9700 1 --2- 172.21.15.55:0/3529951769 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab980a65f0 0x7fab9813f840 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3529951769 >> 172.21.15.55:0/3529951769 conn(0x7fab98068820 msgr2=0x7fab98068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:57.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3529951769 shutdown_connections 2023-09-30T01:55:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3529951769 wait complete. 2023-09-30T01:55:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab9e5e9700 1 Processor -- start 2023-09-30T01:55:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.000+0000 7fab9e5e9700 1 -- start start 2023-09-30T01:55:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9e5e9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab980677c0 0x7fab9806ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9e5e9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab980a65f0 0x7fab98137b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9e5e9700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab9813fd80 0x7fab98138080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9e5e9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9806b2d0 con 0x7fab980677c0 2023-09-30T01:55:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9e5e9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab980b4f40 con 0x7fab980a65f0 2023-09-30T01:55:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9e5e9700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab980b51e0 con 0x7fab9813fd80 2023-09-30T01:55:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9d5e7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab980677c0 0x7fab9806ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9d5e7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab980677c0 0x7fab9806ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57898/0 (socket says 172.21.15.55:57898) 2023-09-30T01:55:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9d5e7700 1 -- 172.21.15.55:0/3036740887 learned_addr learned my addr 172.21.15.55:0/3036740887 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9dde8700 1 --2- 172.21.15.55:0/3036740887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab9813fd80 0x7fab98138080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9cde6700 1 --2- 172.21.15.55:0/3036740887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab980a65f0 0x7fab98137b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9d5e7700 1 -- 172.21.15.55:0/3036740887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab9813fd80 msgr2=0x7fab98138080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9d5e7700 1 --2- 172.21.15.55:0/3036740887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab9813fd80 0x7fab98138080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9d5e7700 1 -- 172.21.15.55:0/3036740887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab980a65f0 msgr2=0x7fab98137b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9d5e7700 1 --2- 172.21.15.55:0/3036740887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab980a65f0 0x7fab98137b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9d5e7700 1 -- 172.21.15.55:0/3036740887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab94009a20 con 0x7fab980677c0 2023-09-30T01:55:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9d5e7700 1 --2- 172.21.15.55:0/3036740887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab980677c0 0x7fab9806ac80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c810 tx=0x7fab88007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:57.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab8d7fa700 1 -- 172.21.15.55:0/3036740887 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88005b30 con 0x7fab980677c0 2023-09-30T01:55:57.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab8d7fa700 1 -- 172.21.15.55:0/3036740887 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab88005c90 con 0x7fab980677c0 2023-09-30T01:55:57.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3036740887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab98144020 con 0x7fab980677c0 2023-09-30T01:55:57.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab8d7fa700 1 -- 172.21.15.55:0/3036740887 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab88007320 con 0x7fab980677c0 2023-09-30T01:55:57.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3036740887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab98142e00 con 0x7fab980677c0 2023-09-30T01:55:57.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.004+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3036740887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab98142ff0 con 0x7fab980677c0 2023-09-30T01:55:57.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.008+0000 7fab8d7fa700 1 -- 172.21.15.55:0/3036740887 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fab8801b3b0 con 0x7fab980677c0 2023-09-30T01:55:57.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.008+0000 7fab8d7fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:55:57.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.008+0000 7fab8d7fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:55:57.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.008+0000 7fab8d7fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:57.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.008+0000 7fab8d7fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:57.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.008+0000 7fab8d7fa700 1 --2- 172.21.15.55:0/3036740887 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fab7c08e8b0 0x7fab7c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.008+0000 7fab9cde6700 1 --2- 172.21.15.55:0/3036740887 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fab7c08e8b0 0x7fab7c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.008+0000 7fab8d7fa700 1 -- 172.21.15.55:0/3036740887 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fab880b3e00 con 0x7fab980677c0 2023-09-30T01:55:57.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.008+0000 7fab9cde6700 1 --2- 172.21.15.55:0/3036740887 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fab7c08e8b0 0x7fab7c090d60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab94009de0 tx=0x7fab94018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:57.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.012+0000 7fab8d7fa700 1 -- 172.21.15.55:0/3036740887 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fab88084c10 con 0x7fab980677c0 2023-09-30T01:55:57.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.176+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3036740887 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab98064440 con 0x7fab980677c0 2023-09-30T01:55:57.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.176+0000 7fab8d7fa700 1 -- 172.21.15.55:0/3036740887 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) v1 ==== 74+0+8977 (secure 0 0 0) 0x7fab8809d330 con 0x7fab980677c0 2023-09-30T01:55:57.179 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:57.180 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":15,"fsid":"37496c89-c485-46e5-8550-5722d2abf46a","created":"2023-09-30T01:55:38.697831+0000","modified":"2023-09-30T01:55:56.581209+0000","last_up_change":"2023-09-30T01:55:48.191927+0000","last_in_change":"2023-09-30T01:55:39.813210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T01:55:49.090600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T01:55:54.370944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27634},{"type":"v1","addr":"172.21.15.55:6801","nonce":27634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27634},{"type":"v1","addr":"172.21.15.55:6803","nonce":27634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27634},{"type":"v1","addr":"172.21.15.55:6807","nonce":27634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27634},{"type":"v1","addr":"172.21.15.55:6805","nonce":27634}]},"public_addr":"172.21.15.55:6801/27634","cluster_addr":"172.21.15.55:6803/27634","heartbeat_back_addr":"172.21.15.55:6807/27634","heartbeat_front_addr":"172.21.15.55:6805/27634","state":["exists","up"]},{"osd":1,"uuid":"b52b4f6f-00aa-4ef8-b3d4-467475cd0bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":30066},{"type":"v1","addr":"172.21.15.133:6809","nonce":30066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":30066},{"type":"v1","addr":"172.21.15.133:6811","nonce":30066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":30066},{"type":"v1","addr":"172.21.15.133:6815","nonce":30066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":30066},{"type":"v1","addr":"172.21.15.133:6813","nonce":30066}]},"public_addr":"172.21.15.133:6809/30066","cluster_addr":"172.21.15.133:6811/30066","heartbeat_back_addr":"172.21.15.133:6815/30066","heartbeat_front_addr":"172.21.15.133:6813/30066","state":["exists","up"]},{"osd":2,"uuid":"c48b2c87-a33c-47fc-8b84-e64faad378b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":30068},{"type":"v1","addr":"172.21.15.133:6817","nonce":30068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":30068},{"type":"v1","addr":"172.21.15.133:6819","nonce":30068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":30068},{"type":"v1","addr":"172.21.15.133:6823","nonce":30068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":30068},{"type":"v1","addr":"172.21.15.133:6821","nonce":30068}]},"public_addr":"172.21.15.133:6817/30068","cluster_addr":"172.21.15.133:6819/30068","heartbeat_back_addr":"172.21.15.133:6823/30068","heartbeat_front_addr":"172.21.15.133:6821/30068","state":["exists","up"]},{"osd":3,"uuid":"614c2d45-f7b8-42e8-ba09-6e042a2358b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":30067},{"type":"v1","addr":"172.21.15.133:6801","nonce":30067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":30067},{"type":"v1","addr":"172.21.15.133:6803","nonce":30067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":30067},{"type":"v1","addr":"172.21.15.133:6807","nonce":30067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":30067},{"type":"v1","addr":"172.21.15.133:6805","nonce":30067}]},"public_addr":"172.21.15.133:6801/30067","cluster_addr":"172.21.15.133:6803/30067","heartbeat_back_addr":"172.21.15.133:6807/30067","heartbeat_front_addr":"172.21.15.133:6805/30067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.342817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.400384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.363652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.069618+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T01:55:57.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.180+0000 7fab9e5e9700 10 mgrc shutdown 2023-09-30T01:55:57.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.180+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3036740887 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fab7c08e8b0 msgr2=0x7fab7c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.180+0000 7fab9e5e9700 1 --2- 172.21.15.55:0/3036740887 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fab7c08e8b0 0x7fab7c090d60 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fab94009de0 tx=0x7fab94018000 comp rx=0 tx=0).stop 2023-09-30T01:55:57.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.180+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3036740887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab980677c0 msgr2=0x7fab9806ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.180+0000 7fab9e5e9700 1 --2- 172.21.15.55:0/3036740887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab980677c0 0x7fab9806ac80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fab8800c810 tx=0x7fab88007e00 comp rx=0 tx=0).stop 2023-09-30T01:55:57.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.180+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3036740887 shutdown_connections 2023-09-30T01:55:57.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.180+0000 7fab9e5e9700 1 --2- 172.21.15.55:0/3036740887 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fab7c08e8b0 0x7fab7c090d60 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.180+0000 7fab9e5e9700 1 --2- 172.21.15.55:0/3036740887 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fab9813fd80 0x7fab98138080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.180+0000 7fab9e5e9700 1 --2- 172.21.15.55:0/3036740887 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fab980a65f0 0x7fab98137b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.180+0000 7fab9e5e9700 1 --2- 172.21.15.55:0/3036740887 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fab980677c0 0x7fab9806ac80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.180+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3036740887 >> 172.21.15.55:0/3036740887 conn(0x7fab98068820 msgr2=0x7fab98068bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:57.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.180+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3036740887 shutdown_connections 2023-09-30T01:55:57.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.180+0000 7fab9e5e9700 1 -- 172.21.15.55:0/3036740887 wait complete. 2023-09-30T01:55:57.193 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-09-30T01:55:49.090600+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '12', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2023-09-30T01:55:54.370944+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '15', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2023-09-30T01:55:57.194 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-09-30T01:55:57.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.304+0000 7ff09bfff700 1 Processor -- start 2023-09-30T01:55:57.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.304+0000 7ff09bfff700 1 -- start start 2023-09-30T01:55:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.304+0000 7ff09bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff09c0672d0 0x7ff09c0a5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.304+0000 7ff09bfff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff09c0a3780 0x7ff09c1408c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.304+0000 7ff09bfff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff09c0676a0 con 0x7ff09c0a8570 2023-09-30T01:55:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.304+0000 7ff09bfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff09c0a5a60 con 0x7ff09c0672d0 2023-09-30T01:55:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.304+0000 7ff09bfff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c0a8b40 con 0x7ff09c0a3780 2023-09-30T01:55:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.304+0000 7ff09a7fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff09c0a3780 0x7ff09c1408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.304+0000 7ff09b7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff09c0a8570 0x7ff09c143590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60174/0 (socket says 172.21.15.55:60174) 2023-09-30T01:55:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.304+0000 7ff09b7fe700 1 -- 172.21.15.55:0/4055149494 learned_addr learned my addr 172.21.15.55:0/4055149494 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:55:57.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.304+0000 7ff09affd700 1 --2- 172.21.15.55:0/4055149494 >> v2:172.21.15.133:3300/0 conn(0x7ff09c0672d0 0x7ff09c0a5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff09a7fc700 1 -- 172.21.15.55:0/4055149494 >> v2:172.21.15.133:3300/0 conn(0x7ff09c0672d0 msgr2=0x7ff09c0a5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff09a7fc700 1 --2- 172.21.15.55:0/4055149494 >> v2:172.21.15.133:3300/0 conn(0x7ff09c0672d0 0x7ff09c0a5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff09a7fc700 1 -- 172.21.15.55:0/4055149494 >> v1:172.21.15.55:6789/0 conn(0x7ff09c0a8570 legacy=0x7ff09c143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff09a7fc700 1 -- 172.21.15.55:0/4055149494 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff09c0a8e00 con 0x7ff09c0a3780 2023-09-30T01:55:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff099ffb700 1 -- 172.21.15.55:0/4055149494 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312187743 0 0) 0x7ff09c0676a0 con 0x7ff09c0a8570 2023-09-30T01:55:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff09a7fc700 1 --2- 172.21.15.55:0/4055149494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff09c0a3780 0x7ff09c1408c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff0840098d0 tx=0x7ff084009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df7826c014932adc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff099ffb700 1 -- 172.21.15.55:0/4055149494 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084005c10 con 0x7ff09c0a3780 2023-09-30T01:55:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff099ffb700 1 -- 172.21.15.55:0/4055149494 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff084005d70 con 0x7ff09c0a3780 2023-09-30T01:55:57.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff099ffb700 1 -- 172.21.15.55:0/4055149494 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff084006280 con 0x7ff09c0a3780 2023-09-30T01:55:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff09bfff700 1 -- 172.21.15.55:0/4055149494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff09c0a3780 msgr2=0x7ff09c1408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff09bfff700 1 --2- 172.21.15.55:0/4055149494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff09c0a3780 0x7ff09c1408c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff0840098d0 tx=0x7ff084009120 comp rx=0 tx=0).stop 2023-09-30T01:55:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff09bfff700 1 -- 172.21.15.55:0/4055149494 shutdown_connections 2023-09-30T01:55:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff09bfff700 1 --2- 172.21.15.55:0/4055149494 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff09c0a3780 0x7ff09c1408c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff09bfff700 1 --2- 172.21.15.55:0/4055149494 >> v2:172.21.15.133:3300/0 conn(0x7ff09c0672d0 0x7ff09c0a5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff09bfff700 1 -- 172.21.15.55:0/4055149494 >> 172.21.15.55:0/4055149494 conn(0x7ff09c062c70 msgr2=0x7ff09c063070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff09bfff700 1 -- 172.21.15.55:0/4055149494 shutdown_connections 2023-09-30T01:55:57.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.308+0000 7ff09bfff700 1 -- 172.21.15.55:0/4055149494 wait complete. 2023-09-30T01:55:57.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09bfff700 1 Processor -- start 2023-09-30T01:55:57.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09bfff700 1 -- start start 2023-09-30T01:55:57.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff09c0672d0 0x7ff09c13c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09bfff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff09c0a3780 0x7ff09c09ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff09c0a8570 0x7ff09c09b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09bfff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c09c8e0 con 0x7ff09c0672d0 2023-09-30T01:55:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09bfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c09bef0 con 0x7ff09c0a8570 2023-09-30T01:55:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09bfff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff09c151350 con 0x7ff09c0a3780 2023-09-30T01:55:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff09c0672d0 0x7ff09c13c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09a7fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff09c0a3780 0x7ff09c09ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09affd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff09c0672d0 0x7ff09c13c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57910/0 (socket says 172.21.15.55:57910) 2023-09-30T01:55:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09affd700 1 -- 172.21.15.55:0/1875205939 learned_addr learned my addr 172.21.15.55:0/1875205939 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09b7fe700 1 --2- 172.21.15.55:0/1875205939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff09c0a8570 0x7ff09c09b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09affd700 1 -- 172.21.15.55:0/1875205939 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff09c0a3780 msgr2=0x7ff09c09ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09affd700 1 --2- 172.21.15.55:0/1875205939 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff09c0a3780 0x7ff09c09ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09affd700 1 -- 172.21.15.55:0/1875205939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff09c0a8570 msgr2=0x7ff09c09b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09affd700 1 --2- 172.21.15.55:0/1875205939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff09c0a8570 0x7ff09c09b3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09affd700 1 -- 172.21.15.55:0/1875205939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0840093c0 con 0x7ff09c0672d0 2023-09-30T01:55:57.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09b7fe700 1 --2- 172.21.15.55:0/1875205939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff09c0a8570 0x7ff09c09b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:55:57.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09affd700 1 --2- 172.21.15.55:0/1875205939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff09c0672d0 0x7ff09c13c0e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00ec80 tx=0x7ff08c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:57.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff092ffd700 1 -- 172.21.15.55:0/1875205939 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c00c850 con 0x7ff09c0672d0 2023-09-30T01:55:57.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff092ffd700 1 -- 172.21.15.55:0/1875205939 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff08c00c9b0 con 0x7ff09c0672d0 2023-09-30T01:55:57.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff092ffd700 1 -- 172.21.15.55:0/1875205939 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff08c00cd50 con 0x7ff09c0672d0 2023-09-30T01:55:57.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.312+0000 7ff09bfff700 1 -- 172.21.15.55:0/1875205939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff09c150be0 con 0x7ff09c0672d0 2023-09-30T01:55:57.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.316+0000 7ff09bfff700 1 -- 172.21.15.55:0/1875205939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff09c13c620 con 0x7ff09c0672d0 2023-09-30T01:55:57.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.316+0000 7ff09bfff700 1 -- 172.21.15.55:0/1875205939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff09c064440 con 0x7ff09c0672d0 2023-09-30T01:55:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.316+0000 7ff092ffd700 1 -- 172.21.15.55:0/1875205939 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7ff08c013680 con 0x7ff09c0672d0 2023-09-30T01:55:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.316+0000 7ff092ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:55:57.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.316+0000 7ff092ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:55:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.316+0000 7ff092ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.316+0000 7ff092ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.316+0000 7ff092ffd700 1 --2- 172.21.15.55:0/1875205939 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff07c08e8b0 0x7ff07c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.316+0000 7ff09a7fc700 1 --2- 172.21.15.55:0/1875205939 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff07c08e8b0 0x7ff07c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.316+0000 7ff092ffd700 1 -- 172.21.15.55:0/1875205939 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7ff08c0b47b0 con 0x7ff09c0672d0 2023-09-30T01:55:57.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.320+0000 7ff09a7fc700 1 --2- 172.21.15.55:0/1875205939 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff07c08e8b0 0x7ff07c090d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff0840098d0 tx=0x7ff084016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:57.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.328+0000 7ff092ffd700 1 -- 172.21.15.55:0/1875205939 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff08c085530 con 0x7ff09c0672d0 2023-09-30T01:55:57.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.488+0000 7ff09bfff700 1 -- 172.21.15.55:0/1875205939 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff09c0a4fd0 con 0x7ff09c0672d0 2023-09-30T01:55:57.491 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.488+0000 7ff092ffd700 1 -- 172.21.15.55:0/1875205939 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v15) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff08c021020 con 0x7ff09c0672d0 2023-09-30T01:55:57.491 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 1 2023-09-30T01:55:57.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.488+0000 7ff09bfff700 10 mgrc shutdown 2023-09-30T01:55:57.493 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.488+0000 7ff09bfff700 1 -- 172.21.15.55:0/1875205939 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff07c08e8b0 msgr2=0x7ff07c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.488+0000 7ff09bfff700 1 --2- 172.21.15.55:0/1875205939 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff07c08e8b0 0x7ff07c090d60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff0840098d0 tx=0x7ff084016000 comp rx=0 tx=0).stop 2023-09-30T01:55:57.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.488+0000 7ff09bfff700 1 -- 172.21.15.55:0/1875205939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff09c0672d0 msgr2=0x7ff09c13c0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.488+0000 7ff09bfff700 1 --2- 172.21.15.55:0/1875205939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff09c0672d0 0x7ff09c13c0e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff08c00ec80 tx=0x7ff08c0091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.488+0000 7ff09bfff700 1 -- 172.21.15.55:0/1875205939 shutdown_connections 2023-09-30T01:55:57.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.492+0000 7ff09bfff700 1 --2- 172.21.15.55:0/1875205939 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff09c0a8570 0x7ff09c09b3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.492+0000 7ff09bfff700 1 --2- 172.21.15.55:0/1875205939 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff07c08e8b0 0x7ff07c090d60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.492+0000 7ff09bfff700 1 --2- 172.21.15.55:0/1875205939 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff09c0a3780 0x7ff09c09ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.492+0000 7ff09bfff700 1 --2- 172.21.15.55:0/1875205939 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff09c0672d0 0x7ff09c13c0e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.492+0000 7ff09bfff700 1 -- 172.21.15.55:0/1875205939 >> 172.21.15.55:0/1875205939 conn(0x7ff09c062c70 msgr2=0x7ff09c0b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:57.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.492+0000 7ff09bfff700 1 -- 172.21.15.55:0/1875205939 shutdown_connections 2023-09-30T01:55:57.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.492+0000 7ff09bfff700 1 -- 172.21.15.55:0/1875205939 wait complete. 2023-09-30T01:55:57.505 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2023-09-30T01:55:57.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc94d1de700 1 Processor -- start 2023-09-30T01:55:57.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc94d1de700 1 -- start start 2023-09-30T01:55:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc94d1de700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9480672d0 0x7fc9480a5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc94d1de700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9480a3780 0x7fc9481408c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc94d1de700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9480676a0 con 0x7fc9480a8570 2023-09-30T01:55:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc94d1de700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9480a5a60 con 0x7fc9480672d0 2023-09-30T01:55:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc94d1de700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9480a8b40 con 0x7fc9480a3780 2023-09-30T01:55:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc9477fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9480a3780 0x7fc9481408c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc9477fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9480a3780 0x7fc9481408c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56828/0 (socket says 172.21.15.55:56828) 2023-09-30T01:55:57.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc9477fe700 1 -- 172.21.15.55:0/1527397002 learned_addr learned my addr 172.21.15.55:0/1527397002 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:57.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc947fff700 1 --2- 172.21.15.55:0/1527397002 >> v2:172.21.15.133:3300/0 conn(0x7fc9480672d0 0x7fc9480a5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc9477fe700 1 -- 172.21.15.55:0/1527397002 >> v2:172.21.15.133:3300/0 conn(0x7fc9480672d0 msgr2=0x7fc9480a5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:57.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc9477fe700 1 --2- 172.21.15.55:0/1527397002 >> v2:172.21.15.133:3300/0 conn(0x7fc9480672d0 0x7fc9480a5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc9477fe700 1 -- 172.21.15.55:0/1527397002 >> v1:172.21.15.133:6789/0 conn(0x7fc9480a8570 legacy=0x7fc948143590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.620+0000 7fc9477fe700 1 -- 172.21.15.55:0/1527397002 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9480a8e00 con 0x7fc9480a3780 2023-09-30T01:55:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc9477fe700 1 --2- 172.21.15.55:0/1527397002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9480a3780 0x7fc9481408c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009990 tx=0x7fc93c009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ce5705362cd587c0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc946ffd700 1 -- 172.21.15.55:0/1527397002 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c009e80 con 0x7fc9480a3780 2023-09-30T01:55:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc946ffd700 1 -- 172.21.15.55:0/1527397002 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc93c005c10 con 0x7fc9480a3780 2023-09-30T01:55:57.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc946ffd700 1 -- 172.21.15.55:0/1527397002 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc93c00b6e0 con 0x7fc9480a3780 2023-09-30T01:55:57.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc94d1de700 1 -- 172.21.15.55:0/1527397002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9480a3780 msgr2=0x7fc9481408c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc94d1de700 1 --2- 172.21.15.55:0/1527397002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9480a3780 0x7fc9481408c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009990 tx=0x7fc93c009220 comp rx=0 tx=0).stop 2023-09-30T01:55:57.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc94d1de700 1 -- 172.21.15.55:0/1527397002 shutdown_connections 2023-09-30T01:55:57.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc94d1de700 1 --2- 172.21.15.55:0/1527397002 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9480a3780 0x7fc9481408c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc94d1de700 1 --2- 172.21.15.55:0/1527397002 >> v2:172.21.15.133:3300/0 conn(0x7fc9480672d0 0x7fc9480a5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc94d1de700 1 -- 172.21.15.55:0/1527397002 >> 172.21.15.55:0/1527397002 conn(0x7fc948062c70 msgr2=0x7fc948063070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:57.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc94d1de700 1 -- 172.21.15.55:0/1527397002 shutdown_connections 2023-09-30T01:55:57.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc94d1de700 1 -- 172.21.15.55:0/1527397002 wait complete. 2023-09-30T01:55:57.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc94d1de700 1 Processor -- start 2023-09-30T01:55:57.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc94d1de700 1 -- start start 2023-09-30T01:55:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.624+0000 7fc94d1de700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9480672d0 0x7fc94809a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc94d1de700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9480a3780 0x7fc94809bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc94d1de700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9480a8570 0x7fc94809c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc94d1de700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc94806eb20 con 0x7fc9480a8570 2023-09-30T01:55:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc94d1de700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc948150570 con 0x7fc9480a3780 2023-09-30T01:55:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc94d1de700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc94809a210 con 0x7fc9480672d0 2023-09-30T01:55:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc947fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9480672d0 0x7fc94809a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc94c9dd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9480a8570 0x7fc94809c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc947fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9480672d0 0x7fc94809a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56840/0 (socket says 172.21.15.55:56840) 2023-09-30T01:55:57.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc947fff700 1 -- 172.21.15.55:0/558097907 learned_addr learned my addr 172.21.15.55:0/558097907 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:57.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc9477fe700 1 --2- 172.21.15.55:0/558097907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9480a3780 0x7fc94809bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc947fff700 1 -- 172.21.15.55:0/558097907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9480a3780 msgr2=0x7fc94809bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc947fff700 1 --2- 172.21.15.55:0/558097907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9480a3780 0x7fc94809bc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc947fff700 1 -- 172.21.15.55:0/558097907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9480a8570 msgr2=0x7fc94809c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc947fff700 1 --2- 172.21.15.55:0/558097907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9480a8570 0x7fc94809c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc947fff700 1 -- 172.21.15.55:0/558097907 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc93c009480 con 0x7fc9480672d0 2023-09-30T01:55:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc947fff700 1 --2- 172.21.15.55:0/558097907 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9480672d0 0x7fc94809a790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc940009ef0 tx=0x7fc94000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc92ffff700 1 -- 172.21.15.55:0/558097907 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc94000cb70 con 0x7fc9480672d0 2023-09-30T01:55:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc92ffff700 1 -- 172.21.15.55:0/558097907 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc94000f040 con 0x7fc9480672d0 2023-09-30T01:55:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc94d1de700 1 -- 172.21.15.55:0/558097907 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc94806d2b0 con 0x7fc9480672d0 2023-09-30T01:55:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc92ffff700 1 -- 172.21.15.55:0/558097907 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc940014480 con 0x7fc9480672d0 2023-09-30T01:55:57.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc94d1de700 1 -- 172.21.15.55:0/558097907 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc94809aef0 con 0x7fc9480672d0 2023-09-30T01:55:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.628+0000 7fc94d1de700 1 -- 172.21.15.55:0/558097907 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc94809a490 con 0x7fc9480672d0 2023-09-30T01:55:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.632+0000 7fc92ffff700 1 -- 172.21.15.55:0/558097907 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc9400147f0 con 0x7fc9480672d0 2023-09-30T01:55:57.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.632+0000 7fc92ffff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:55:57.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.632+0000 7fc92ffff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:55:57.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.632+0000 7fc92ffff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:57.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.632+0000 7fc92ffff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:57.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.632+0000 7fc92ffff700 1 --2- 172.21.15.55:0/558097907 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc93408e8b0 0x7fc934090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.632+0000 7fc9477fe700 1 --2- 172.21.15.55:0/558097907 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc93408e8b0 0x7fc934090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.632+0000 7fc92ffff700 1 -- 172.21.15.55:0/558097907 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fc9400b4d40 con 0x7fc9480672d0 2023-09-30T01:55:57.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.632+0000 7fc9477fe700 1 --2- 172.21.15.55:0/558097907 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc93408e8b0 0x7fc934090d60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009990 tx=0x7fc93c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:57.642 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.640+0000 7fc92ffff700 1 -- 172.21.15.55:0/558097907 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc940085b50 con 0x7fc9480672d0 2023-09-30T01:55:57.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.804+0000 7fc94d1de700 1 -- 172.21.15.55:0/558097907 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc948064440 con 0x7fc9480672d0 2023-09-30T01:55:57.808 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.804+0000 7fc92ffff700 1 -- 172.21.15.55:0/558097907 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v15) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc940089170 con 0x7fc9480672d0 2023-09-30T01:55:57.808 INFO:teuthology.orchestra.run.smithi055.stdout:pg_num: 8 2023-09-30T01:55:57.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.808+0000 7fc94d1de700 10 mgrc shutdown 2023-09-30T01:55:57.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.808+0000 7fc94d1de700 1 -- 172.21.15.55:0/558097907 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc93408e8b0 msgr2=0x7fc934090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.808+0000 7fc94d1de700 1 --2- 172.21.15.55:0/558097907 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc93408e8b0 0x7fc934090d60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc93c009990 tx=0x7fc93c016000 comp rx=0 tx=0).stop 2023-09-30T01:55:57.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.808+0000 7fc94d1de700 1 -- 172.21.15.55:0/558097907 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9480672d0 msgr2=0x7fc94809a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.808+0000 7fc94d1de700 1 --2- 172.21.15.55:0/558097907 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9480672d0 0x7fc94809a790 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fc940009ef0 tx=0x7fc94000b040 comp rx=0 tx=0).stop 2023-09-30T01:55:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.808+0000 7fc94d1de700 1 -- 172.21.15.55:0/558097907 shutdown_connections 2023-09-30T01:55:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.808+0000 7fc94d1de700 1 --2- 172.21.15.55:0/558097907 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9480a8570 0x7fc94809c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.808+0000 7fc94d1de700 1 --2- 172.21.15.55:0/558097907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9480a3780 0x7fc94809bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.808+0000 7fc94d1de700 1 --2- 172.21.15.55:0/558097907 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc93408e8b0 0x7fc934090d60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.808+0000 7fc94d1de700 1 --2- 172.21.15.55:0/558097907 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9480672d0 0x7fc94809a790 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.808+0000 7fc94d1de700 1 -- 172.21.15.55:0/558097907 >> 172.21.15.55:0/558097907 conn(0x7fc948062c70 msgr2=0x7fc9480b6da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.808+0000 7fc94d1de700 1 -- 172.21.15.55:0/558097907 shutdown_connections 2023-09-30T01:55:57.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.808+0000 7fc94d1de700 1 -- 172.21.15.55:0/558097907 wait complete. 2023-09-30T01:55:57.827 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-09-30T01:55:57.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.932+0000 7fcd52184700 1 Processor -- start 2023-09-30T01:55:57.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.932+0000 7fcd52184700 1 -- start start 2023-09-30T01:55:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.932+0000 7fcd52184700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd4c0677c0 0x7fcd4c0a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.932+0000 7fcd52184700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcd4c0a65f0 0x7fcd4c13f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.932+0000 7fcd52184700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd4c13fd80 0x7fcd4c0a6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.932+0000 7fcd52184700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4c067b90 con 0x7fcd4c0677c0 2023-09-30T01:55:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.932+0000 7fcd52184700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd4c0a5460 con 0x7fcd4c0a65f0 2023-09-30T01:55:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.932+0000 7fcd52184700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c0a5720 con 0x7fcd4c13fd80 2023-09-30T01:55:57.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.932+0000 7fcd51983700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd4c13fd80 0x7fcd4c0a6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.932+0000 7fcd51182700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcd4c0677c0 0x7fcd4c0a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.932+0000 7fcd51983700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd4c13fd80 0x7fcd4c0a6d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56846/0 (socket says 172.21.15.55:56846) 2023-09-30T01:55:57.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.932+0000 7fcd51983700 1 -- 172.21.15.55:0/1604921363 learned_addr learned my addr 172.21.15.55:0/1604921363 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:57.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.932+0000 7fcd50981700 1 --2- 172.21.15.55:0/1604921363 >> v2:172.21.15.133:3300/0 conn(0x7fcd4c0a65f0 0x7fcd4c13f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd51983700 1 -- 172.21.15.55:0/1604921363 >> v2:172.21.15.133:3300/0 conn(0x7fcd4c0a65f0 msgr2=0x7fcd4c13f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd51983700 1 --2- 172.21.15.55:0/1604921363 >> v2:172.21.15.133:3300/0 conn(0x7fcd4c0a65f0 0x7fcd4c13f840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd51983700 1 -- 172.21.15.55:0/1604921363 >> v2:172.21.15.55:3300/0 conn(0x7fcd4c0677c0 msgr2=0x7fcd4c0a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd51983700 1 --2- 172.21.15.55:0/1604921363 >> v2:172.21.15.55:3300/0 conn(0x7fcd4c0677c0 0x7fcd4c0a93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd51983700 1 -- 172.21.15.55:0/1604921363 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd4c0a9910 con 0x7fcd4c13fd80 2023-09-30T01:55:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd51983700 1 --2- 172.21.15.55:0/1604921363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd4c13fd80 0x7fcd4c0a6d20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c141220 tx=0x7fcd44009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=341a169fe91f22fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd43fff700 1 -- 172.21.15.55:0/1604921363 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4400e070 con 0x7fcd4c13fd80 2023-09-30T01:55:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd43fff700 1 -- 172.21.15.55:0/1604921363 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4400b970 con 0x7fcd4c13fd80 2023-09-30T01:55:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd43fff700 1 -- 172.21.15.55:0/1604921363 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd440092e0 con 0x7fcd4c13fd80 2023-09-30T01:55:57.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd52184700 1 -- 172.21.15.55:0/1604921363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd4c13fd80 msgr2=0x7fcd4c0a6d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd52184700 1 --2- 172.21.15.55:0/1604921363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd4c13fd80 0x7fcd4c0a6d20 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fcd4c141220 tx=0x7fcd44009840 comp rx=0 tx=0).stop 2023-09-30T01:55:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd52184700 1 -- 172.21.15.55:0/1604921363 shutdown_connections 2023-09-30T01:55:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd52184700 1 --2- 172.21.15.55:0/1604921363 >> v2:172.21.15.133:3300/0 conn(0x7fcd4c0a65f0 0x7fcd4c13f840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd52184700 1 --2- 172.21.15.55:0/1604921363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd4c13fd80 0x7fcd4c0a6d20 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd52184700 1 --2- 172.21.15.55:0/1604921363 >> v2:172.21.15.55:3300/0 conn(0x7fcd4c0677c0 0x7fcd4c0a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd52184700 1 -- 172.21.15.55:0/1604921363 >> 172.21.15.55:0/1604921363 conn(0x7fcd4c068820 msgr2=0x7fcd4c068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd52184700 1 -- 172.21.15.55:0/1604921363 shutdown_connections 2023-09-30T01:55:57.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.936+0000 7fcd52184700 1 -- 172.21.15.55:0/1604921363 wait complete. 2023-09-30T01:55:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd52184700 1 Processor -- start 2023-09-30T01:55:57.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd52184700 1 -- start start 2023-09-30T01:55:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd52184700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd4c0677c0 0x7fcd4c143110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd52184700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4c0a65f0 0x7fcd4c138a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd52184700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd4c13fd80 0x7fcd4c138f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd52184700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c1394d0 con 0x7fcd4c0a65f0 2023-09-30T01:55:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd52184700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c1396d0 con 0x7fcd4c13fd80 2023-09-30T01:55:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd52184700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4c139990 con 0x7fcd4c0677c0 2023-09-30T01:55:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd51182700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd4c0677c0 0x7fcd4c143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd50981700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4c0a65f0 0x7fcd4c138a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd50981700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4c0a65f0 0x7fcd4c138a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57936/0 (socket says 172.21.15.55:57936) 2023-09-30T01:55:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd51182700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd4c0677c0 0x7fcd4c143110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56854/0 (socket says 172.21.15.55:56854) 2023-09-30T01:55:57.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd50981700 1 -- 172.21.15.55:0/688249006 learned_addr learned my addr 172.21.15.55:0/688249006 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:57.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd51983700 1 --2- 172.21.15.55:0/688249006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd4c13fd80 0x7fcd4c138f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd50981700 1 -- 172.21.15.55:0/688249006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd4c0677c0 msgr2=0x7fcd4c143110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd50981700 1 --2- 172.21.15.55:0/688249006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd4c0677c0 0x7fcd4c143110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd50981700 1 -- 172.21.15.55:0/688249006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd4c13fd80 msgr2=0x7fcd4c138f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:57.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd50981700 1 --2- 172.21.15.55:0/688249006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd4c13fd80 0x7fcd4c138f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:57.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd50981700 1 -- 172.21.15.55:0/688249006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd44009ae0 con 0x7fcd4c0a65f0 2023-09-30T01:55:57.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd50981700 1 --2- 172.21.15.55:0/688249006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4c0a65f0 0x7fcd4c138a50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800ec80 tx=0x7fcd480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:57.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd417fa700 1 -- 172.21.15.55:0/688249006 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4800c8e0 con 0x7fcd4c0a65f0 2023-09-30T01:55:57.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd417fa700 1 -- 172.21.15.55:0/688249006 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd4800ca60 con 0x7fcd4c0a65f0 2023-09-30T01:55:57.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd417fa700 1 -- 172.21.15.55:0/688249006 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd4800ce20 con 0x7fcd4c0a65f0 2023-09-30T01:55:57.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd52184700 1 -- 172.21.15.55:0/688249006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4c1418f0 con 0x7fcd4c0a65f0 2023-09-30T01:55:57.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.940+0000 7fcd52184700 1 -- 172.21.15.55:0/688249006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd4c1443f0 con 0x7fcd4c0a65f0 2023-09-30T01:55:57.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.944+0000 7fcd52184700 1 -- 172.21.15.55:0/688249006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4c064440 con 0x7fcd4c0a65f0 2023-09-30T01:55:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.944+0000 7fcd417fa700 1 -- 172.21.15.55:0/688249006 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fcd48013680 con 0x7fcd4c0a65f0 2023-09-30T01:55:57.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.944+0000 7fcd417fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:55:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.948+0000 7fcd417fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:55:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.948+0000 7fcd417fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.948+0000 7fcd417fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.948+0000 7fcd417fa700 1 --2- 172.21.15.55:0/688249006 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcd3008e8e0 0x7fcd30090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.948+0000 7fcd51182700 1 --2- 172.21.15.55:0/688249006 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcd3008e8e0 0x7fcd30090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:57.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.948+0000 7fcd417fa700 1 -- 172.21.15.55:0/688249006 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fcd480b5000 con 0x7fcd4c0a65f0 2023-09-30T01:55:57.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.948+0000 7fcd51182700 1 --2- 172.21.15.55:0/688249006 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcd3008e8e0 0x7fcd30090d90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009db0 tx=0x7fcd3c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:57.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:57.952+0000 7fcd417fa700 1 -- 172.21.15.55:0/688249006 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcd48085d80 con 0x7fcd4c0a65f0 2023-09-30T01:55:58.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.120+0000 7fcd52184700 1 -- 172.21.15.55:0/688249006 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcd4c06ea90 con 0x7fcd4c0a65f0 2023-09-30T01:55:58.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.124+0000 7fcd417fa700 1 -- 172.21.15.55:0/688249006 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v15) v1 ==== 84+0+126 (secure 0 0 0) 0x7fcd48021020 con 0x7fcd4c0a65f0 2023-09-30T01:55:58.126 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:55:58.126 INFO:teuthology.orchestra.run.smithi055.stdout:[ 2023-09-30T01:55:58.126 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-09-30T01:55:58.126 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 1, 2023-09-30T01:55:58.126 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": ".mgr" 2023-09-30T01:55:58.126 INFO:teuthology.orchestra.run.smithi055.stdout: }, 2023-09-30T01:55:58.126 INFO:teuthology.orchestra.run.smithi055.stdout: { 2023-09-30T01:55:58.127 INFO:teuthology.orchestra.run.smithi055.stdout: "poolnum": 2, 2023-09-30T01:55:58.127 INFO:teuthology.orchestra.run.smithi055.stdout: "poolname": "rbd" 2023-09-30T01:55:58.127 INFO:teuthology.orchestra.run.smithi055.stdout: } 2023-09-30T01:55:58.127 INFO:teuthology.orchestra.run.smithi055.stdout:] 2023-09-30T01:55:58.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.124+0000 7fcd52184700 10 mgrc shutdown 2023-09-30T01:55:58.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.124+0000 7fcd52184700 1 -- 172.21.15.55:0/688249006 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcd3008e8e0 msgr2=0x7fcd30090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:58.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.124+0000 7fcd52184700 1 --2- 172.21.15.55:0/688249006 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcd3008e8e0 0x7fcd30090d90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcd3c009db0 tx=0x7fcd3c0091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.124+0000 7fcd52184700 1 -- 172.21.15.55:0/688249006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4c0a65f0 msgr2=0x7fcd4c138a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:58.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.124+0000 7fcd52184700 1 --2- 172.21.15.55:0/688249006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4c0a65f0 0x7fcd4c138a50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcd4800ec80 tx=0x7fcd480091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.124+0000 7fcd52184700 1 -- 172.21.15.55:0/688249006 shutdown_connections 2023-09-30T01:55:58.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.124+0000 7fcd52184700 1 --2- 172.21.15.55:0/688249006 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcd4c13fd80 0x7fcd4c138f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.124+0000 7fcd52184700 1 --2- 172.21.15.55:0/688249006 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcd4c0a65f0 0x7fcd4c138a50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.124+0000 7fcd52184700 1 --2- 172.21.15.55:0/688249006 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcd3008e8e0 0x7fcd30090d90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.124+0000 7fcd52184700 1 --2- 172.21.15.55:0/688249006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcd4c0677c0 0x7fcd4c143110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.124+0000 7fcd52184700 1 -- 172.21.15.55:0/688249006 >> 172.21.15.55:0/688249006 conn(0x7fcd4c068820 msgr2=0x7fcd4c0a3ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:58.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.124+0000 7fcd52184700 1 -- 172.21.15.55:0/688249006 shutdown_connections 2023-09-30T01:55:58.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.124+0000 7fcd52184700 1 -- 172.21.15.55:0/688249006 wait complete. 2023-09-30T01:55:58.140 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-09-30T01:55:58.140 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-09-30T01:55:58.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.248+0000 7fc9fe6e7700 1 Processor -- start 2023-09-30T01:55:58.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.248+0000 7fc9fe6e7700 1 -- start start 2023-09-30T01:55:58.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.248+0000 7fc9fe6e7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9f80a54a0 0x7fc9f813f720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:58.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.248+0000 7fc9fe6e7700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f80a47d0 con 0x7fc9f80672d0 2023-09-30T01:55:58.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.248+0000 7fc9fe6e7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9f80676a0 con 0x7fc9f813fc60 2023-09-30T01:55:58.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.248+0000 7fc9fe6e7700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9f80a8550 con 0x7fc9f80a54a0 2023-09-30T01:55:58.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9fcee4700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9f80a54a0 0x7fc9f813f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:58.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9fd6e5700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc9f80672d0 0x7fc9f80a3a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60184/0 (socket says 172.21.15.55:60184) 2023-09-30T01:55:58.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9fd6e5700 1 -- 172.21.15.55:0/1857787580 learned_addr learned my addr 172.21.15.55:0/1857787580 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:55:58.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9fcee4700 1 -- 172.21.15.55:0/1857787580 >> v1:172.21.15.133:6789/0 conn(0x7fc9f813fc60 legacy=0x7fc9f814a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:58.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9fcee4700 1 -- 172.21.15.55:0/1857787580 >> v1:172.21.15.55:6789/0 conn(0x7fc9f80672d0 legacy=0x7fc9f80a3a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:58.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9effff700 1 -- 172.21.15.55:0/1857787580 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1255350058 0 0) 0x7fc9f80676a0 con 0x7fc9f813fc60 2023-09-30T01:55:58.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9fcee4700 1 -- 172.21.15.55:0/1857787580 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f80a87f0 con 0x7fc9f80a54a0 2023-09-30T01:55:58.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9fcee4700 1 --2- 172.21.15.55:0/1857787580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9f80a54a0 0x7fc9f813f720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40098e0 tx=0x7fc9f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c482c675395e96e1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:58.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9effff700 1 -- 172.21.15.55:0/1857787580 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4009e80 con 0x7fc9f80a54a0 2023-09-30T01:55:58.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9effff700 1 -- 172.21.15.55:0/1857787580 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f400b760 con 0x7fc9f80a54a0 2023-09-30T01:55:58.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9effff700 1 -- 172.21.15.55:0/1857787580 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f400bae0 con 0x7fc9f80a54a0 2023-09-30T01:55:58.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/1857787580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9f80a54a0 msgr2=0x7fc9f813f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:58.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9fe6e7700 1 --2- 172.21.15.55:0/1857787580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9f80a54a0 0x7fc9f813f720 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fc9f40098e0 tx=0x7fc9f40091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/1857787580 shutdown_connections 2023-09-30T01:55:58.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9fe6e7700 1 --2- 172.21.15.55:0/1857787580 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9f80a54a0 0x7fc9f813f720 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/1857787580 >> 172.21.15.55:0/1857787580 conn(0x7fc9f8062c70 msgr2=0x7fc9f8063070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:58.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/1857787580 shutdown_connections 2023-09-30T01:55:58.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.252+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/1857787580 wait complete. 2023-09-30T01:55:58.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fe6e7700 1 Processor -- start 2023-09-30T01:55:58.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fe6e7700 1 -- start start 2023-09-30T01:55:58.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fe6e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9f80672d0 0x7fc9f806e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:58.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fe6e7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9f80a54a0 0x7fc9f8143540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:58.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fe6e7700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9f813fc60 0x7fc9f8143a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:58.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fe6e7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f81464b0 con 0x7fc9f80a54a0 2023-09-30T01:55:58.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fe6e7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f8143fc0 con 0x7fc9f80672d0 2023-09-30T01:55:58.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fe6e7700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9f806b010 con 0x7fc9f813fc60 2023-09-30T01:55:58.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fcee4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9f80a54a0 0x7fc9f8143540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:58.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fdee6700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9f813fc60 0x7fc9f8143a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:58.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fcee4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9f80a54a0 0x7fc9f8143540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57956/0 (socket says 172.21.15.55:57956) 2023-09-30T01:55:58.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fcee4700 1 -- 172.21.15.55:0/858516391 learned_addr learned my addr 172.21.15.55:0/858516391 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:58.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fd6e5700 1 --2- 172.21.15.55:0/858516391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9f80672d0 0x7fc9f806e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:58.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fdee6700 1 -- 172.21.15.55:0/858516391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9f80672d0 msgr2=0x7fc9f806e1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:58.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fdee6700 1 --2- 172.21.15.55:0/858516391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9f80672d0 0x7fc9f806e1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fdee6700 1 -- 172.21.15.55:0/858516391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9f80a54a0 msgr2=0x7fc9f8143540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:58.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fdee6700 1 --2- 172.21.15.55:0/858516391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9f80a54a0 0x7fc9f8143540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fdee6700 1 -- 172.21.15.55:0/858516391 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9f4009420 con 0x7fc9f813fc60 2023-09-30T01:55:58.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fdee6700 1 --2- 172.21.15.55:0/858516391 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9f813fc60 0x7fc9f8143a80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000c7e0 tx=0x7fc9f00015f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:58.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9ed7fa700 1 -- 172.21.15.55:0/858516391 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0011590 con 0x7fc9f813fc60 2023-09-30T01:55:58.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9ed7fa700 1 -- 172.21.15.55:0/858516391 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9f00116f0 con 0x7fc9f813fc60 2023-09-30T01:55:58.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/858516391 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9f8144910 con 0x7fc9f813fc60 2023-09-30T01:55:58.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9ed7fa700 1 -- 172.21.15.55:0/858516391 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9f0011ab0 con 0x7fc9f813fc60 2023-09-30T01:55:58.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.256+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/858516391 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9f806d830 con 0x7fc9f813fc60 2023-09-30T01:55:58.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.260+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/858516391 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9f8064440 con 0x7fc9f813fc60 2023-09-30T01:55:58.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.260+0000 7fc9ed7fa700 1 -- 172.21.15.55:0/858516391 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc9f0012420 con 0x7fc9f813fc60 2023-09-30T01:55:58.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.260+0000 7fc9ed7fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:55:58.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.260+0000 7fc9ed7fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:55:58.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.260+0000 7fc9ed7fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:58.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.260+0000 7fc9ed7fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:58.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.260+0000 7fc9ed7fa700 1 --2- 172.21.15.55:0/858516391 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc9dc08e8b0 0x7fc9dc090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:58.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.264+0000 7fc9fd6e5700 1 --2- 172.21.15.55:0/858516391 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc9dc08e8b0 0x7fc9dc090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:58.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.264+0000 7fc9ed7fa700 1 -- 172.21.15.55:0/858516391 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3478+0+0 (secure 0 0 0) 0x7fc9f00b4220 con 0x7fc9f813fc60 2023-09-30T01:55:58.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.264+0000 7fc9fd6e5700 1 --2- 172.21.15.55:0/858516391 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc9dc08e8b0 0x7fc9dc090d60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80058d0 tx=0x7fc9e8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:58.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.264+0000 7fc9ed7fa700 1 -- 172.21.15.55:0/858516391 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc9f0084fa0 con 0x7fc9f813fc60 2023-09-30T01:55:58.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.428+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/858516391 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc9f804b5c0 con 0x7fc9f813fc60 2023-09-30T01:55:58.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.732+0000 7fc9ed7fa700 1 -- 172.21.15.55:0/858516391 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v16) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc9f00885c0 con 0x7fc9f813fc60 2023-09-30T01:55:58.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.736+0000 7fc9fe6e7700 10 mgrc shutdown 2023-09-30T01:55:58.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.736+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/858516391 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc9dc08e8b0 msgr2=0x7fc9dc090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:58.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.736+0000 7fc9fe6e7700 1 --2- 172.21.15.55:0/858516391 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc9dc08e8b0 0x7fc9dc090d60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fc9e80058d0 tx=0x7fc9e8009040 comp rx=0 tx=0).stop 2023-09-30T01:55:58.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.736+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/858516391 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9f813fc60 msgr2=0x7fc9f8143a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:58.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.736+0000 7fc9fe6e7700 1 --2- 172.21.15.55:0/858516391 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9f813fc60 0x7fc9f8143a80 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc9f000c7e0 tx=0x7fc9f00015f0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.736+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/858516391 shutdown_connections 2023-09-30T01:55:58.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.736+0000 7fc9fe6e7700 1 --2- 172.21.15.55:0/858516391 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc9dc08e8b0 0x7fc9dc090d60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.736+0000 7fc9fe6e7700 1 --2- 172.21.15.55:0/858516391 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9f813fc60 0x7fc9f8143a80 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.736+0000 7fc9fe6e7700 1 --2- 172.21.15.55:0/858516391 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9f80a54a0 0x7fc9f8143540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.736+0000 7fc9fe6e7700 1 --2- 172.21.15.55:0/858516391 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9f80672d0 0x7fc9f806e1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.736+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/858516391 >> 172.21.15.55:0/858516391 conn(0x7fc9f8062c70 msgr2=0x7fc9f806ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:58.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.736+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/858516391 shutdown_connections 2023-09-30T01:55:58.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.736+0000 7fc9fe6e7700 1 -- 172.21.15.55:0/858516391 wait complete. 2023-09-30T01:55:58.741 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_metadata' created 2023-09-30T01:55:58.757 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-09-30T01:55:58.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.876+0000 7fb3ea690700 1 Processor -- start 2023-09-30T01:55:58.880 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.876+0000 7fb3ea690700 1 -- start start 2023-09-30T01:55:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.876+0000 7fb3ea690700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3e40b74e0 0x7fb3e406d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.876+0000 7fb3ea690700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb3e4143e60 0x7fb3e4135e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.876+0000 7fb3ea690700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3e41439d0 con 0x7fb3e4144270 2023-09-30T01:55:58.881 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.876+0000 7fb3ea690700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3e40b78b0 con 0x7fb3e4143e60 2023-09-30T01:55:58.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.876+0000 7fb3ea690700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e406dc80 con 0x7fb3e40b74e0 2023-09-30T01:55:58.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3e3fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3e40b74e0 0x7fb3e406d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:58.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3db7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb3e4143e60 0x7fb3e4135e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:58.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3e8c2d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb3e4144270 0x7fb3e4136380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60200/0 (socket says 172.21.15.55:60200) 2023-09-30T01:55:58.882 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3e8c2d700 1 -- 172.21.15.55:0/1028558149 learned_addr learned my addr 172.21.15.55:0/1028558149 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:55:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3e37fe700 1 -- 172.21.15.55:0/1028558149 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 540187908 0 0) 0x7fb3e41439d0 con 0x7fb3e4144270 2023-09-30T01:55:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3e37fe700 1 -- 172.21.15.55:0/1028558149 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb3d0003570 con 0x7fb3e4144270 2023-09-30T01:55:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3e3fff700 1 -- 172.21.15.55:0/1028558149 >> v2:172.21.15.55:3300/0 conn(0x7fb3e4143e60 msgr2=0x7fb3e4135e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:55:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3e3fff700 1 --2- 172.21.15.55:0/1028558149 >> v2:172.21.15.55:3300/0 conn(0x7fb3e4143e60 0x7fb3e4135e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3e3fff700 1 -- 172.21.15.55:0/1028558149 >> v1:172.21.15.55:6789/0 conn(0x7fb3e4144270 legacy=0x7fb3e4136380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3e3fff700 1 -- 172.21.15.55:0/1028558149 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3e406b130 con 0x7fb3e40b74e0 2023-09-30T01:55:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3e3fff700 1 --2- 172.21.15.55:0/1028558149 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3e40b74e0 0x7fb3e406d740 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40098e0 tx=0x7fb3d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f713eb211d17aa1d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3e37fe700 1 -- 172.21.15.55:0/1028558149 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4011630 con 0x7fb3e40b74e0 2023-09-30T01:55:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3e37fe700 1 -- 172.21.15.55:0/1028558149 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3d4011790 con 0x7fb3e40b74e0 2023-09-30T01:55:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3e37fe700 1 -- 172.21.15.55:0/1028558149 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3d4011b30 con 0x7fb3e40b74e0 2023-09-30T01:55:58.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3ea690700 1 -- 172.21.15.55:0/1028558149 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3e40b74e0 msgr2=0x7fb3e406d740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:58.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3ea690700 1 --2- 172.21.15.55:0/1028558149 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3e40b74e0 0x7fb3e406d740 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fb3d40098e0 tx=0x7fb3d40091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3ea690700 1 -- 172.21.15.55:0/1028558149 shutdown_connections 2023-09-30T01:55:58.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3ea690700 1 --2- 172.21.15.55:0/1028558149 >> v2:172.21.15.55:3300/0 conn(0x7fb3e4143e60 0x7fb3e4135e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3ea690700 1 --2- 172.21.15.55:0/1028558149 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3e40b74e0 0x7fb3e406d740 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3ea690700 1 -- 172.21.15.55:0/1028558149 >> 172.21.15.55:0/1028558149 conn(0x7fb3e4068a30 msgr2=0x7fb3e40b6ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:58.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3ea690700 1 -- 172.21.15.55:0/1028558149 shutdown_connections 2023-09-30T01:55:58.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.880+0000 7fb3ea690700 1 -- 172.21.15.55:0/1028558149 wait complete. 2023-09-30T01:55:58.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3ea690700 1 Processor -- start 2023-09-30T01:55:58.886 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3ea690700 1 -- start start 2023-09-30T01:55:58.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3ea690700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3e40b74e0 0x7fb3e40b0ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:58.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3ea690700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e4143e60 0x7fb3e4150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:58.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3ea690700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e4144270 0x7fb3e4150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:58.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3ea690700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e4151180 con 0x7fb3e4144270 2023-09-30T01:55:58.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3ea690700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e40b0410 con 0x7fb3e4143e60 2023-09-30T01:55:58.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3ea690700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e40ab910 con 0x7fb3e40b74e0 2023-09-30T01:55:58.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3e3fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3e40b74e0 0x7fb3e40b0ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:58.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3e8c2d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e4144270 0x7fb3e4150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3e3fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3e40b74e0 0x7fb3e40b0ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56876/0 (socket says 172.21.15.55:56876) 2023-09-30T01:55:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3e3fff700 1 -- 172.21.15.55:0/509795788 learned_addr learned my addr 172.21.15.55:0/509795788 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3e8c2d700 1 --2- 172.21.15.55:0/509795788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e4144270 0x7fb3e4150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57970/0 (socket says 172.21.15.55:57970) 2023-09-30T01:55:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3db7fe700 1 --2- 172.21.15.55:0/509795788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e4143e60 0x7fb3e4150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3e8c2d700 1 -- 172.21.15.55:0/509795788 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3e40b74e0 msgr2=0x7fb3e40b0ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3e8c2d700 1 --2- 172.21.15.55:0/509795788 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3e40b74e0 0x7fb3e40b0ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3e8c2d700 1 -- 172.21.15.55:0/509795788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e4143e60 msgr2=0x7fb3e4150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3e8c2d700 1 --2- 172.21.15.55:0/509795788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e4143e60 0x7fb3e4150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3e8c2d700 1 -- 172.21.15.55:0/509795788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3d4009420 con 0x7fb3e4144270 2023-09-30T01:55:58.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.884+0000 7fb3e8c2d700 1 --2- 172.21.15.55:0/509795788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e4144270 0x7fb3e4150c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb3e406e3c0 tx=0x7fb3dc001980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:58.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.888+0000 7fb3e0ff9700 1 -- 172.21.15.55:0/509795788 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc00a8b0 con 0x7fb3e4144270 2023-09-30T01:55:58.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.888+0000 7fb3e0ff9700 1 -- 172.21.15.55:0/509795788 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3dc00aa10 con 0x7fb3e4144270 2023-09-30T01:55:58.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.888+0000 7fb3ea690700 1 -- 172.21.15.55:0/509795788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e40abbd0 con 0x7fb3e4144270 2023-09-30T01:55:58.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.888+0000 7fb3e0ff9700 1 -- 172.21.15.55:0/509795788 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3dc00ad90 con 0x7fb3e4144270 2023-09-30T01:55:58.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.888+0000 7fb3ea690700 1 -- 172.21.15.55:0/509795788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e40ad2e0 con 0x7fb3e4144270 2023-09-30T01:55:58.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.888+0000 7fb3ea690700 1 -- 172.21.15.55:0/509795788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e4068510 con 0x7fb3e4144270 2023-09-30T01:55:58.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.888+0000 7fb3e0ff9700 1 -- 172.21.15.55:0/509795788 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fb3dc007300 con 0x7fb3e4144270 2023-09-30T01:55:58.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.888+0000 7fb3e0ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:55:58.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.892+0000 7fb3e0ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:55:58.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.892+0000 7fb3e0ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:58.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.892+0000 7fb3e0ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:58.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.892+0000 7fb3e0ff9700 1 --2- 172.21.15.55:0/509795788 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb3c408e8b0 0x7fb3c4090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:58.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.892+0000 7fb3e3fff700 1 --2- 172.21.15.55:0/509795788 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb3c408e8b0 0x7fb3c4090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:58.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.892+0000 7fb3e0ff9700 1 -- 172.21.15.55:0/509795788 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3848+0+0 (secure 0 0 0) 0x7fb3dc0b4350 con 0x7fb3e4144270 2023-09-30T01:55:58.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.892+0000 7fb3e3fff700 1 --2- 172.21.15.55:0/509795788 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb3c408e8b0 0x7fb3c4090d60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4011fd0 tx=0x7fb3d4017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:58.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:58.900+0000 7fb3e0ff9700 1 -- 172.21.15.55:0/509795788 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb3dc049be0 con 0x7fb3e4144270 2023-09-30T01:55:59.067 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.064+0000 7fb3ea690700 1 -- 172.21.15.55:0/509795788 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb3e41363f0 con 0x7fb3e4144270 2023-09-30T01:55:59.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.764+0000 7fb3e0ff9700 1 -- 172.21.15.55:0/509795788 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v17) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb3dc017030 con 0x7fb3e4144270 2023-09-30T01:55:59.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.768+0000 7fb3ea690700 10 mgrc shutdown 2023-09-30T01:55:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.768+0000 7fb3ea690700 1 -- 172.21.15.55:0/509795788 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb3c408e8b0 msgr2=0x7fb3c4090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.768+0000 7fb3ea690700 1 --2- 172.21.15.55:0/509795788 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb3c408e8b0 0x7fb3c4090d60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb3d4011fd0 tx=0x7fb3d4017000 comp rx=0 tx=0).stop 2023-09-30T01:55:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.768+0000 7fb3ea690700 1 -- 172.21.15.55:0/509795788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e4144270 msgr2=0x7fb3e4150c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:59.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.768+0000 7fb3ea690700 1 --2- 172.21.15.55:0/509795788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e4144270 0x7fb3e4150c40 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb3e406e3c0 tx=0x7fb3dc001980 comp rx=0 tx=0).stop 2023-09-30T01:55:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.768+0000 7fb3ea690700 1 -- 172.21.15.55:0/509795788 shutdown_connections 2023-09-30T01:55:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.768+0000 7fb3ea690700 1 --2- 172.21.15.55:0/509795788 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3e4144270 0x7fb3e4150c40 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.768+0000 7fb3ea690700 1 --2- 172.21.15.55:0/509795788 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3e4143e60 0x7fb3e4150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.768+0000 7fb3ea690700 1 --2- 172.21.15.55:0/509795788 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb3c408e8b0 0x7fb3c4090d60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.768+0000 7fb3ea690700 1 --2- 172.21.15.55:0/509795788 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb3e40b74e0 0x7fb3e40b0ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.768+0000 7fb3ea690700 1 -- 172.21.15.55:0/509795788 >> 172.21.15.55:0/509795788 conn(0x7fb3e4068a30 msgr2=0x7fb3e40a9020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:59.773 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.768+0000 7fb3ea690700 1 -- 172.21.15.55:0/509795788 shutdown_connections 2023-09-30T01:55:59.774 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.768+0000 7fb3ea690700 1 -- 172.21.15.55:0/509795788 wait complete. 2023-09-30T01:55:59.774 INFO:teuthology.orchestra.run.smithi055.stderr:pool 'cephfs_data' created 2023-09-30T01:55:59.787 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-09-30T01:55:59.888 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.884+0000 7f902d495700 1 Processor -- start 2023-09-30T01:55:59.889 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.884+0000 7f902d495700 1 -- start start 2023-09-30T01:55:59.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.884+0000 7f902d495700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280a8570 0x7f90280a5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:59.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.884+0000 7f902d495700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9028140fd0 con 0x7f90280672d0 2023-09-30T01:55:59.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.884+0000 7f902d495700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90280676a0 con 0x7f90280a3780 2023-09-30T01:55:59.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.884+0000 7f902d495700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90280a5a60 con 0x7f90280a8570 2023-09-30T01:55:59.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902cc94700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280a8570 0x7f90280a5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:59.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f9027fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f90280672d0 0x7f90281408c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60208/0 (socket says 172.21.15.55:60208) 2023-09-30T01:55:59.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f9027fff700 1 -- 172.21.15.55:0/2911244951 learned_addr learned my addr 172.21.15.55:0/2911244951 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:55:59.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f9026ffd700 1 -- 172.21.15.55:0/2911244951 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3372088228 0 0) 0x7f9028140fd0 con 0x7f90280672d0 2023-09-30T01:55:59.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902cc94700 1 -- 172.21.15.55:0/2911244951 >> v1:172.21.15.133:6789/0 conn(0x7f90280a3780 legacy=0x7f9028148900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:59.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902cc94700 1 -- 172.21.15.55:0/2911244951 >> v1:172.21.15.55:6789/0 conn(0x7f90280672d0 legacy=0x7f90281408c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:59.892 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902cc94700 1 -- 172.21.15.55:0/2911244951 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90280a8b40 con 0x7f90280a8570 2023-09-30T01:55:59.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902cc94700 1 --2- 172.21.15.55:0/2911244951 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280a8570 0x7f90280a5520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9020009910 tx=0x7f90200091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a2e25a6ce9b65d21 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:59.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f9026ffd700 1 -- 172.21.15.55:0/2911244951 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902000b8f0 con 0x7f90280a8570 2023-09-30T01:55:59.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f9026ffd700 1 -- 172.21.15.55:0/2911244951 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f902000ba50 con 0x7f90280a8570 2023-09-30T01:55:59.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f9026ffd700 1 -- 172.21.15.55:0/2911244951 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f902000bdf0 con 0x7f90280a8570 2023-09-30T01:55:59.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 -- 172.21.15.55:0/2911244951 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280a8570 msgr2=0x7f90280a5520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:59.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 --2- 172.21.15.55:0/2911244951 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280a8570 0x7f90280a5520 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f9020009910 tx=0x7f90200091a0 comp rx=0 tx=0).stop 2023-09-30T01:55:59.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 -- 172.21.15.55:0/2911244951 shutdown_connections 2023-09-30T01:55:59.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 --2- 172.21.15.55:0/2911244951 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280a8570 0x7f90280a5520 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:59.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 -- 172.21.15.55:0/2911244951 >> 172.21.15.55:0/2911244951 conn(0x7f9028062c70 msgr2=0x7f9028063070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:55:59.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 -- 172.21.15.55:0/2911244951 shutdown_connections 2023-09-30T01:55:59.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 -- 172.21.15.55:0/2911244951 wait complete. 2023-09-30T01:55:59.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 Processor -- start 2023-09-30T01:55:59.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 -- start start 2023-09-30T01:55:59.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280672d0 0x7f902809cee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:59.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90280a3780 0x7f902814ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:59.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90280a8570 0x7f902813c5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:59.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902809c1e0 con 0x7f90280a8570 2023-09-30T01:55:59.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f902809c3e0 con 0x7f90280a3780 2023-09-30T01:55:59.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902d495700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90281507d0 con 0x7f90280672d0 2023-09-30T01:55:59.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f9027fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280672d0 0x7f902809cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:59.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f902cc94700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90280a8570 0x7f902813c5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:59.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f9027fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280672d0 0x7f902809cee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56898/0 (socket says 172.21.15.55:56898) 2023-09-30T01:55:59.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.888+0000 7f9027fff700 1 -- 172.21.15.55:0/3603065420 learned_addr learned my addr 172.21.15.55:0/3603065420 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:55:59.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.892+0000 7f90277fe700 1 --2- 172.21.15.55:0/3603065420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90280a3780 0x7f902814ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:59.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.892+0000 7f9027fff700 1 -- 172.21.15.55:0/3603065420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90280a3780 msgr2=0x7f902814ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:59.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.892+0000 7f9027fff700 1 --2- 172.21.15.55:0/3603065420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90280a3780 0x7f902814ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:59.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.892+0000 7f9027fff700 1 -- 172.21.15.55:0/3603065420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90280a8570 msgr2=0x7f902813c5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:55:59.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.892+0000 7f9027fff700 1 --2- 172.21.15.55:0/3603065420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90280a8570 0x7f902813c5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:55:59.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.892+0000 7f9027fff700 1 -- 172.21.15.55:0/3603065420 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9020009420 con 0x7f90280672d0 2023-09-30T01:55:59.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.892+0000 7f902cc94700 1 --2- 172.21.15.55:0/3603065420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90280a8570 0x7f902813c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:55:59.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.892+0000 7f9027fff700 1 --2- 172.21.15.55:0/3603065420 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280672d0 0x7f902809cee0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f901c00c810 tx=0x7f901c007d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:59.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.892+0000 7f900ffff700 1 -- 172.21.15.55:0/3603065420 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c005c00 con 0x7f90280672d0 2023-09-30T01:55:59.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.892+0000 7f900ffff700 1 -- 172.21.15.55:0/3603065420 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901c005d60 con 0x7f90280672d0 2023-09-30T01:55:59.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.892+0000 7f902d495700 1 -- 172.21.15.55:0/3603065420 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9028150a90 con 0x7f90280672d0 2023-09-30T01:55:59.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.892+0000 7f900ffff700 1 -- 172.21.15.55:0/3603065420 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901c007320 con 0x7f90280672d0 2023-09-30T01:55:59.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.892+0000 7f902d495700 1 -- 172.21.15.55:0/3603065420 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f902813cae0 con 0x7f90280672d0 2023-09-30T01:55:59.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.892+0000 7f902d495700 1 -- 172.21.15.55:0/3603065420 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9028064440 con 0x7f90280672d0 2023-09-30T01:55:59.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.896+0000 7f900ffff700 1 -- 172.21.15.55:0/3603065420 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f901c01b3b0 con 0x7f90280672d0 2023-09-30T01:55:59.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.896+0000 7f900ffff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:55:59.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.896+0000 7f900ffff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:55:59.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.896+0000 7f900ffff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:59.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.896+0000 7f900ffff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:55:59.899 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.896+0000 7f900ffff700 1 --2- 172.21.15.55:0/3603065420 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f901408e8b0 0x7f9014090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:55:59.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.896+0000 7f90277fe700 1 --2- 172.21.15.55:0/3603065420 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f901408e8b0 0x7f9014090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:55:59.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.896+0000 7f900ffff700 1 -- 172.21.15.55:0/3603065420 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4230+0+0 (secure 0 0 0) 0x7f901c0b3d60 con 0x7f90280672d0 2023-09-30T01:55:59.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.896+0000 7f90277fe700 1 --2- 172.21.15.55:0/3603065420 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f901408e8b0 0x7f9014090d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f902806f4a0 tx=0x7f9018001b20 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:55:59.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:55:59.904+0000 7f900ffff700 1 -- 172.21.15.55:0/3603065420 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f901c084750 con 0x7f90280672d0 2023-09-30T01:56:00.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.096+0000 7f902d495700 1 -- 172.21.15.55:0/3603065420 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f902813df70 con 0x7f90280672d0 2023-09-30T01:56:00.118 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.116+0000 7f900ffff700 1 -- 172.21.15.55:0/3603065420 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f901c017020 con 0x7f90280672d0 2023-09-30T01:56:00.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.120+0000 7f902d495700 10 mgrc shutdown 2023-09-30T01:56:00.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.120+0000 7f902d495700 1 -- 172.21.15.55:0/3603065420 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f901408e8b0 msgr2=0x7f9014090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.120+0000 7f902d495700 1 --2- 172.21.15.55:0/3603065420 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f901408e8b0 0x7f9014090d60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f902806f4a0 tx=0x7f9018001b20 comp rx=0 tx=0).stop 2023-09-30T01:56:00.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.120+0000 7f902d495700 1 -- 172.21.15.55:0/3603065420 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280672d0 msgr2=0x7f902809cee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.120+0000 7f902d495700 1 --2- 172.21.15.55:0/3603065420 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280672d0 0x7f902809cee0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f901c00c810 tx=0x7f901c007d90 comp rx=0 tx=0).stop 2023-09-30T01:56:00.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.124+0000 7f902d495700 1 -- 172.21.15.55:0/3603065420 shutdown_connections 2023-09-30T01:56:00.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.124+0000 7f902d495700 1 --2- 172.21.15.55:0/3603065420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90280a8570 0x7f902813c5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.124+0000 7f902d495700 1 --2- 172.21.15.55:0/3603065420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90280a3780 0x7f902814ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.124+0000 7f902d495700 1 --2- 172.21.15.55:0/3603065420 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f901408e8b0 0x7f9014090d60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.124+0000 7f902d495700 1 --2- 172.21.15.55:0/3603065420 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90280672d0 0x7f902809cee0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.124+0000 7f902d495700 1 -- 172.21.15.55:0/3603065420 >> 172.21.15.55:0/3603065420 conn(0x7f9028062c70 msgr2=0x7f902813d6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.124+0000 7f902d495700 1 -- 172.21.15.55:0/3603065420 shutdown_connections 2023-09-30T01:56:00.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.124+0000 7f902d495700 1 -- 172.21.15.55:0/3603065420 wait complete. 2023-09-30T01:56:00.127 INFO:teuthology.orchestra.run.smithi055.stderr:new fs with metadata pool 3 and data pool 4 2023-09-30T01:56:00.140 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T01:56:00.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.232+0000 7f9e6759e700 1 Processor -- start 2023-09-30T01:56:00.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.232+0000 7f9e6759e700 1 -- start start 2023-09-30T01:56:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.232+0000 7f9e6759e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e680a9130 0x7f9e6806b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.232+0000 7f9e6759e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e680a38e0 con 0x7f9e68136030 2023-09-30T01:56:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.232+0000 7f9e6759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e680a69c0 con 0x7f9e680a3d70 2023-09-30T01:56:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.232+0000 7f9e6759e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e6806bae0 con 0x7f9e680a9130 2023-09-30T01:56:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.232+0000 7f9e66d9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9e68136030 0x7f9e68136430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60216/0 (socket says 172.21.15.55:60216) 2023-09-30T01:56:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.232+0000 7f9e6659c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9e680a9130 0x7f9e6806b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.232+0000 7f9e66d9d700 1 -- 172.21.15.55:0/582186139 learned_addr learned my addr 172.21.15.55:0/582186139 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6559a700 1 -- 172.21.15.55:0/582186139 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 914415651 0 0) 0x7f9e680a38e0 con 0x7f9e68136030 2023-09-30T01:56:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6559a700 1 -- 172.21.15.55:0/582186139 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e54003570 con 0x7f9e68136030 2023-09-30T01:56:00.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6659c700 1 -- 172.21.15.55:0/582186139 >> v1:172.21.15.133:6789/0 conn(0x7f9e680a3d70 legacy=0x7f9e680a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6559a700 1 -- 172.21.15.55:0/582186139 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3250260061 0 0) 0x7f9e54003570 con 0x7f9e68136030 2023-09-30T01:56:00.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6659c700 1 -- 172.21.15.55:0/582186139 >> v1:172.21.15.55:6789/0 conn(0x7f9e68136030 legacy=0x7f9e68136430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6659c700 1 -- 172.21.15.55:0/582186139 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e680a9500 con 0x7f9e680a9130 2023-09-30T01:56:00.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6659c700 1 --2- 172.21.15.55:0/582186139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e680a9130 0x7f9e6806b5a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9e580098e0 tx=0x7f9e580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c1c0d8afb0b7042 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:00.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6559a700 1 -- 172.21.15.55:0/582186139 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e600017f0 con 0x7f9e680a9130 2023-09-30T01:56:00.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6559a700 1 -- 172.21.15.55:0/582186139 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e58011420 con 0x7f9e680a9130 2023-09-30T01:56:00.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6559a700 1 -- 172.21.15.55:0/582186139 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e580117a0 con 0x7f9e680a9130 2023-09-30T01:56:00.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6759e700 1 -- 172.21.15.55:0/582186139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e680a9130 msgr2=0x7f9e6806b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6759e700 1 --2- 172.21.15.55:0/582186139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e680a9130 0x7f9e6806b5a0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9e580098e0 tx=0x7f9e580091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6759e700 1 -- 172.21.15.55:0/582186139 shutdown_connections 2023-09-30T01:56:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6759e700 1 --2- 172.21.15.55:0/582186139 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e680a9130 0x7f9e6806b5a0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6759e700 1 -- 172.21.15.55:0/582186139 >> 172.21.15.55:0/582186139 conn(0x7f9e680b6940 msgr2=0x7f9e680b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6759e700 1 -- 172.21.15.55:0/582186139 shutdown_connections 2023-09-30T01:56:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6759e700 1 -- 172.21.15.55:0/582186139 wait complete. 2023-09-30T01:56:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6759e700 1 Processor -- start 2023-09-30T01:56:00.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.236+0000 7f9e6759e700 1 -- start start 2023-09-30T01:56:00.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6759e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e680a3d70 0x7f9e68142810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6759e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9e680a9130 0x7f9e68152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e68136030 0x7f9e68153410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6759e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e68153e20 con 0x7f9e680a3d70 2023-09-30T01:56:00.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e6814d380 con 0x7f9e68136030 2023-09-30T01:56:00.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6759e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e68153950 con 0x7f9e680a9130 2023-09-30T01:56:00.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e680a3d70 0x7f9e68142810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e65d9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9e680a9130 0x7f9e68152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6659c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e680a3d70 0x7f9e68142810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57992/0 (socket says 172.21.15.55:57992) 2023-09-30T01:56:00.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6659c700 1 -- 172.21.15.55:0/2821166903 learned_addr learned my addr 172.21.15.55:0/2821166903 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:00.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e66d9d700 1 --2- 172.21.15.55:0/2821166903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e68136030 0x7f9e68153410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6659c700 1 -- 172.21.15.55:0/2821166903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9e680a9130 msgr2=0x7f9e68152ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6659c700 1 --2- 172.21.15.55:0/2821166903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9e680a9130 0x7f9e68152ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6659c700 1 -- 172.21.15.55:0/2821166903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e68136030 msgr2=0x7f9e68153410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6659c700 1 --2- 172.21.15.55:0/2821166903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e68136030 0x7f9e68153410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6659c700 1 -- 172.21.15.55:0/2821166903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e58009420 con 0x7f9e680a3d70 2023-09-30T01:56:00.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6659c700 1 --2- 172.21.15.55:0/2821166903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e680a3d70 0x7f9e68142810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e58009fd0 tx=0x7f9e58016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:00.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e5e7fc700 1 -- 172.21.15.55:0/2821166903 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5801cb80 con 0x7f9e680a3d70 2023-09-30T01:56:00.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e5e7fc700 1 -- 172.21.15.55:0/2821166903 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e5801cce0 con 0x7f9e680a3d70 2023-09-30T01:56:00.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e5e7fc700 1 -- 172.21.15.55:0/2821166903 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e5801a6a0 con 0x7f9e680a3d70 2023-09-30T01:56:00.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6759e700 1 -- 172.21.15.55:0/2821166903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e68135e40 con 0x7f9e680a3d70 2023-09-30T01:56:00.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6759e700 1 -- 172.21.15.55:0/2821166903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e681325c0 con 0x7f9e680a3d70 2023-09-30T01:56:00.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.240+0000 7f9e6759e700 1 -- 172.21.15.55:0/2821166903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e68132840 con 0x7f9e680a3d70 2023-09-30T01:56:00.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.244+0000 7f9e5e7fc700 1 -- 172.21.15.55:0/2821166903 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f9e5801aad0 con 0x7f9e680a3d70 2023-09-30T01:56:00.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.244+0000 7f9e5e7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.244+0000 7f9e5e7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.244+0000 7f9e5e7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.244+0000 7f9e5e7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.244+0000 7f9e5e7fc700 1 --2- 172.21.15.55:0/2821166903 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9e4808e8b0 0x7f9e48090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.244+0000 7f9e65d9b700 1 --2- 172.21.15.55:0/2821166903 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9e4808e8b0 0x7f9e48090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.244+0000 7f9e5e7fc700 1 -- 172.21.15.55:0/2821166903 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f9e580b67c0 con 0x7f9e680a3d70 2023-09-30T01:56:00.248 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.244+0000 7f9e65d9b700 1 --2- 172.21.15.55:0/2821166903 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9e4808e8b0 0x7f9e48090d60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e6806d7f0 tx=0x7f9e50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:00.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.252+0000 7f9e5e7fc700 1 -- 172.21.15.55:0/2821166903 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9e580871e0 con 0x7f9e680a3d70 2023-09-30T01:56:00.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.412+0000 7f9e6759e700 1 -- 172.21.15.55:0/2821166903 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e68135de0 con 0x7f9e680a3d70 2023-09-30T01:56:00.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.412+0000 7f9e5e7fc700 1 -- 172.21.15.55:0/2821166903 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12207 (secure 0 0 0) 0x7f9e5808a800 con 0x7f9e680a3d70 2023-09-30T01:56:00.417 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:00.417 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":18,"fsid":"37496c89-c485-46e5-8550-5722d2abf46a","created":"2023-09-30T01:55:38.697831+0000","modified":"2023-09-30T01:56:00.102339+0000","last_up_change":"2023-09-30T01:55:48.191927+0000","last_in_change":"2023-09-30T01:55:39.813210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T01:55:49.090600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T01:55:54.370944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T01:55:58.474504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T01:55:59.107639+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27634},{"type":"v1","addr":"172.21.15.55:6801","nonce":27634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27634},{"type":"v1","addr":"172.21.15.55:6803","nonce":27634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27634},{"type":"v1","addr":"172.21.15.55:6807","nonce":27634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27634},{"type":"v1","addr":"172.21.15.55:6805","nonce":27634}]},"public_addr":"172.21.15.55:6801/27634","cluster_addr":"172.21.15.55:6803/27634","heartbeat_back_addr":"172.21.15.55:6807/27634","heartbeat_front_addr":"172.21.15.55:6805/27634","state":["exists","up"]},{"osd":1,"uuid":"b52b4f6f-00aa-4ef8-b3d4-467475cd0bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":30066},{"type":"v1","addr":"172.21.15.133:6809","nonce":30066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":30066},{"type":"v1","addr":"172.21.15.133:6811","nonce":30066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":30066},{"type":"v1","addr":"172.21.15.133:6815","nonce":30066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":30066},{"type":"v1","addr":"172.21.15.133:6813","nonce":30066}]},"public_addr":"172.21.15.133:6809/30066","cluster_addr":"172.21.15.133:6811/30066","heartbeat_back_addr":"172.21.15.133:6815/30066","heartbeat_front_addr":"172.21.15.133:6813/30066","state":["exists","up"]},{"osd":2,"uuid":"c48b2c87-a33c-47fc-8b84-e64faad378b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":30068},{"type":"v1","addr":"172.21.15.133:6817","nonce":30068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":30068},{"type":"v1","addr":"172.21.15.133:6819","nonce":30068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":30068},{"type":"v1","addr":"172.21.15.133:6823","nonce":30068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":30068},{"type":"v1","addr":"172.21.15.133:6821","nonce":30068}]},"public_addr":"172.21.15.133:6817/30068","cluster_addr":"172.21.15.133:6819/30068","heartbeat_back_addr":"172.21.15.133:6823/30068","heartbeat_front_addr":"172.21.15.133:6821/30068","state":["exists","up"]},{"osd":3,"uuid":"614c2d45-f7b8-42e8-ba09-6e042a2358b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":30067},{"type":"v1","addr":"172.21.15.133:6801","nonce":30067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":30067},{"type":"v1","addr":"172.21.15.133:6803","nonce":30067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":30067},{"type":"v1","addr":"172.21.15.133:6807","nonce":30067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":30067},{"type":"v1","addr":"172.21.15.133:6805","nonce":30067}]},"public_addr":"172.21.15.133:6801/30067","cluster_addr":"172.21.15.133:6803/30067","heartbeat_back_addr":"172.21.15.133:6807/30067","heartbeat_front_addr":"172.21.15.133:6805/30067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.342817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.400384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.363652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.069618+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T01:56:00.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.416+0000 7f9e6759e700 10 mgrc shutdown 2023-09-30T01:56:00.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.416+0000 7f9e6759e700 1 -- 172.21.15.55:0/2821166903 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9e4808e8b0 msgr2=0x7f9e48090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.416+0000 7f9e6759e700 1 --2- 172.21.15.55:0/2821166903 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9e4808e8b0 0x7f9e48090d60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f9e6806d7f0 tx=0x7f9e50009040 comp rx=0 tx=0).stop 2023-09-30T01:56:00.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.416+0000 7f9e6759e700 1 -- 172.21.15.55:0/2821166903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e680a3d70 msgr2=0x7f9e68142810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.416+0000 7f9e6759e700 1 --2- 172.21.15.55:0/2821166903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e680a3d70 0x7f9e68142810 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9e58009fd0 tx=0x7f9e58016000 comp rx=0 tx=0).stop 2023-09-30T01:56:00.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.416+0000 7f9e6759e700 1 -- 172.21.15.55:0/2821166903 shutdown_connections 2023-09-30T01:56:00.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.416+0000 7f9e6759e700 1 --2- 172.21.15.55:0/2821166903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9e68136030 0x7f9e68153410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.416+0000 7f9e6759e700 1 --2- 172.21.15.55:0/2821166903 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9e4808e8b0 0x7f9e48090d60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.416+0000 7f9e6759e700 1 --2- 172.21.15.55:0/2821166903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9e680a9130 0x7f9e68152ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.416+0000 7f9e6759e700 1 --2- 172.21.15.55:0/2821166903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9e680a3d70 0x7f9e68142810 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.416+0000 7f9e6759e700 1 -- 172.21.15.55:0/2821166903 >> 172.21.15.55:0/2821166903 conn(0x7f9e680b6940 msgr2=0x7f9e68143e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:00.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.416+0000 7f9e6759e700 1 -- 172.21.15.55:0/2821166903 shutdown_connections 2023-09-30T01:56:00.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.416+0000 7f9e6759e700 1 -- 172.21.15.55:0/2821166903 wait complete. 2023-09-30T01:56:00.432 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T01:56:00.535 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e930e700 1 Processor -- start 2023-09-30T01:56:00.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e930e700 1 -- start start 2023-09-30T01:56:00.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e930e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f97e40a4990 0x7f97e40aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e930e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e40af120 con 0x7f97e413a750 2023-09-30T01:56:00.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e930e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97e40af5b0 con 0x7f97e40a4d60 2023-09-30T01:56:00.538 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e930e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e409fb10 con 0x7f97e40a4990 2023-09-30T01:56:00.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e8b0d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f97e413a750 0x7f97e414ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60220/0 (socket says 172.21.15.55:60220) 2023-09-30T01:56:00.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e8b0d700 1 -- 172.21.15.55:0/3949933789 learned_addr learned my addr 172.21.15.55:0/3949933789 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:00.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e3fff700 1 --2- 172.21.15.55:0/3949933789 >> v2:172.21.15.133:3300/0 conn(0x7f97e40a4990 0x7f97e40aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e2ffd700 1 -- 172.21.15.55:0/3949933789 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2685498990 0 0) 0x7f97e40af120 con 0x7f97e413a750 2023-09-30T01:56:00.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e2ffd700 1 -- 172.21.15.55:0/3949933789 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97cc003570 con 0x7f97e413a750 2023-09-30T01:56:00.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e2ffd700 1 -- 172.21.15.55:0/3949933789 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4028470045 0 0) 0x7f97cc003570 con 0x7f97e413a750 2023-09-30T01:56:00.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e2ffd700 1 -- 172.21.15.55:0/3949933789 >> v2:172.21.15.133:3300/0 conn(0x7f97e40a4990 msgr2=0x7f97e40aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:00.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e2ffd700 1 --2- 172.21.15.55:0/3949933789 >> v2:172.21.15.133:3300/0 conn(0x7f97e40a4990 0x7f97e40aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e2ffd700 1 -- 172.21.15.55:0/3949933789 >> v1:172.21.15.133:6789/0 conn(0x7f97e40a4d60 legacy=0x7f97e40a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.539 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.532+0000 7f97e2ffd700 1 -- 172.21.15.55:0/3949933789 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e409fdd0 con 0x7f97e413a750 2023-09-30T01:56:00.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e2ffd700 1 -- 172.21.15.55:0/3949933789 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 254224620 0 0) 0x7f97dc0017f0 con 0x7f97e413a750 2023-09-30T01:56:00.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e2ffd700 1 -- 172.21.15.55:0/3949933789 >> v1:172.21.15.55:6789/0 conn(0x7f97e413a750 legacy=0x7f97e414ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e2ffd700 1 --2- 172.21.15.55:0/3949933789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97cc003a60 0x7f97cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e2ffd700 1 --2- 172.21.15.55:0/3949933789 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97cc004810 0x7f97cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e2ffd700 1 --2- 172.21.15.55:0/3949933789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97cc0051c0 0x7f97cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e2ffd700 1 -- 172.21.15.55:0/3949933789 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e409fb10 con 0x7f97cc0051c0 2023-09-30T01:56:00.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e2ffd700 1 -- 172.21.15.55:0/3949933789 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc00c160 con 0x7f97cc003a60 2023-09-30T01:56:00.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e2ffd700 1 -- 172.21.15.55:0/3949933789 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97cc00c320 con 0x7f97cc004810 2023-09-30T01:56:00.540 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e8b0d700 1 --2- 172.21.15.55:0/3949933789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97cc0051c0 0x7f97cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e37fe700 1 --2- 172.21.15.55:0/3949933789 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97cc004810 0x7f97cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e3fff700 1 --2- 172.21.15.55:0/3949933789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97cc003a60 0x7f97cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.541 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e8b0d700 1 -- 172.21.15.55:0/3949933789 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97cc004810 msgr2=0x7f97cc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:00.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e8b0d700 1 --2- 172.21.15.55:0/3949933789 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97cc004810 0x7f97cc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e8b0d700 1 -- 172.21.15.55:0/3949933789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97cc003a60 msgr2=0x7f97cc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:00.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e8b0d700 1 --2- 172.21.15.55:0/3949933789 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97cc003a60 0x7f97cc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e8b0d700 1 -- 172.21.15.55:0/3949933789 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97cc003570 con 0x7f97cc0051c0 2023-09-30T01:56:00.542 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e8b0d700 1 -- 172.21.15.55:0/3949933789 reap_dead start 2023-09-30T01:56:00.543 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e8b0d700 1 --2- 172.21.15.55:0/3949933789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97cc0051c0 0x7f97cc00ba60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00a930 tx=0x7f97dc0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3993c7b3c3e99464 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e2ffd700 1 -- 172.21.15.55:0/3949933789 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc0070d0 con 0x7f97cc0051c0 2023-09-30T01:56:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e2ffd700 1 -- 172.21.15.55:0/3949933789 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc007270 con 0x7f97cc0051c0 2023-09-30T01:56:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e2ffd700 1 -- 172.21.15.55:0/3949933789 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc007630 con 0x7f97cc0051c0 2023-09-30T01:56:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e930e700 1 -- 172.21.15.55:0/3949933789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97cc0051c0 msgr2=0x7f97cc00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.546 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e930e700 1 --2- 172.21.15.55:0/3949933789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97cc0051c0 0x7f97cc00ba60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f97dc00a930 tx=0x7f97dc0021d0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e930e700 1 -- 172.21.15.55:0/3949933789 shutdown_connections 2023-09-30T01:56:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e930e700 1 --2- 172.21.15.55:0/3949933789 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97cc0051c0 0x7f97cc00ba60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e930e700 1 -- 172.21.15.55:0/3949933789 >> 172.21.15.55:0/3949933789 conn(0x7f97e40b23d0 msgr2=0x7f97e40b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e930e700 1 -- 172.21.15.55:0/3949933789 shutdown_connections 2023-09-30T01:56:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.536+0000 7f97e930e700 1 -- 172.21.15.55:0/3949933789 wait complete. 2023-09-30T01:56:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e930e700 1 Processor -- start 2023-09-30T01:56:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e930e700 1 -- start start 2023-09-30T01:56:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e930e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97cc0051c0 0x7f97e4147980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e930e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97e406e670 0x7f97e41386d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.547 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e930e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97e4138c10 0x7f97e406cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e930e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e406ee60 con 0x7f97e406e670 2023-09-30T01:56:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e930e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e4139090 con 0x7f97e4138c10 2023-09-30T01:56:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e930e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e4139340 con 0x7f97cc0051c0 2023-09-30T01:56:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e3fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97cc0051c0 0x7f97e4147980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e3fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97cc0051c0 0x7f97e4147980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56934/0 (socket says 172.21.15.55:56934) 2023-09-30T01:56:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e3fff700 1 -- 172.21.15.55:0/4288828642 learned_addr learned my addr 172.21.15.55:0/4288828642 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e37fe700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97e406e670 0x7f97e41386d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e8b0d700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97e4138c10 0x7f97e406cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e3fff700 1 -- 172.21.15.55:0/4288828642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97e4138c10 msgr2=0x7f97e406cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e3fff700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97e4138c10 0x7f97e406cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e3fff700 1 -- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97e406e670 msgr2=0x7f97e41386d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e3fff700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97e406e670 0x7f97e41386d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e3fff700 1 -- 172.21.15.55:0/4288828642 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e4139600 con 0x7f97cc0051c0 2023-09-30T01:56:00.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e37fe700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97e406e670 0x7f97e41386d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:00.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e8b0d700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97e4138c10 0x7f97e406cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:56:00.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e3fff700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97cc0051c0 0x7f97e4147980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97d8006ac0 tx=0x7f97d80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:00.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97cbfff700 1 -- 172.21.15.55:0/4288828642 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800f940 con 0x7f97cc0051c0 2023-09-30T01:56:00.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97cbfff700 1 -- 172.21.15.55:0/4288828642 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97d800faa0 con 0x7f97cc0051c0 2023-09-30T01:56:00.549 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97e930e700 1 -- 172.21.15.55:0/4288828642 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e4137c10 con 0x7f97cc0051c0 2023-09-30T01:56:00.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.540+0000 7f97cbfff700 1 -- 172.21.15.55:0/4288828642 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97d800fe20 con 0x7f97cc0051c0 2023-09-30T01:56:00.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.544+0000 7f97e930e700 1 -- 172.21.15.55:0/4288828642 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e406d2d0 con 0x7f97cc0051c0 2023-09-30T01:56:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.544+0000 7f97e930e700 1 -- 172.21.15.55:0/4288828642 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e4064440 con 0x7f97cc0051c0 2023-09-30T01:56:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.544+0000 7f97cbfff700 1 -- 172.21.15.55:0/4288828642 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f97d8014650 con 0x7f97cc0051c0 2023-09-30T01:56:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.544+0000 7f97cbfff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.548+0000 7f97cbfff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.548+0000 7f97cbfff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.548+0000 7f97cbfff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.548+0000 7f97cbfff700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f97d008e8b0 0x7f97d0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.548+0000 7f97e37fe700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f97d008e8b0 0x7f97d0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.548+0000 7f97cbfff700 1 -- 172.21.15.55:0/4288828642 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f97d8018030 con 0x7f97cc0051c0 2023-09-30T01:56:00.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.548+0000 7f97e37fe700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f97d008e8b0 0x7f97d0090d60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f97e40a3e10 tx=0x7f97d4007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:00.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.556+0000 7f97cbfff700 1 -- 172.21.15.55:0/4288828642 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f97d8085b90 con 0x7f97cc0051c0 2023-09-30T01:56:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.712+0000 7f97e930e700 1 -- 172.21.15.55:0/4288828642 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f97e40a0090 con 0x7f97cc0051c0 2023-09-30T01:56:00.716 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.712+0000 7f97cbfff700 1 -- 172.21.15.55:0/4288828642 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+12207 (secure 0 0 0) 0x7f97d8022090 con 0x7f97cc0051c0 2023-09-30T01:56:00.717 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:00.717 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":18,"fsid":"37496c89-c485-46e5-8550-5722d2abf46a","created":"2023-09-30T01:55:38.697831+0000","modified":"2023-09-30T01:56:00.102339+0000","last_up_change":"2023-09-30T01:55:48.191927+0000","last_in_change":"2023-09-30T01:55:39.813210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T01:55:49.090600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T01:55:54.370944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T01:55:58.474504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T01:55:59.107639+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27634},{"type":"v1","addr":"172.21.15.55:6801","nonce":27634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27634},{"type":"v1","addr":"172.21.15.55:6803","nonce":27634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27634},{"type":"v1","addr":"172.21.15.55:6807","nonce":27634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27634},{"type":"v1","addr":"172.21.15.55:6805","nonce":27634}]},"public_addr":"172.21.15.55:6801/27634","cluster_addr":"172.21.15.55:6803/27634","heartbeat_back_addr":"172.21.15.55:6807/27634","heartbeat_front_addr":"172.21.15.55:6805/27634","state":["exists","up"]},{"osd":1,"uuid":"b52b4f6f-00aa-4ef8-b3d4-467475cd0bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":30066},{"type":"v1","addr":"172.21.15.133:6809","nonce":30066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":30066},{"type":"v1","addr":"172.21.15.133:6811","nonce":30066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":30066},{"type":"v1","addr":"172.21.15.133:6815","nonce":30066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":30066},{"type":"v1","addr":"172.21.15.133:6813","nonce":30066}]},"public_addr":"172.21.15.133:6809/30066","cluster_addr":"172.21.15.133:6811/30066","heartbeat_back_addr":"172.21.15.133:6815/30066","heartbeat_front_addr":"172.21.15.133:6813/30066","state":["exists","up"]},{"osd":2,"uuid":"c48b2c87-a33c-47fc-8b84-e64faad378b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":30068},{"type":"v1","addr":"172.21.15.133:6817","nonce":30068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":30068},{"type":"v1","addr":"172.21.15.133:6819","nonce":30068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":30068},{"type":"v1","addr":"172.21.15.133:6823","nonce":30068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":30068},{"type":"v1","addr":"172.21.15.133:6821","nonce":30068}]},"public_addr":"172.21.15.133:6817/30068","cluster_addr":"172.21.15.133:6819/30068","heartbeat_back_addr":"172.21.15.133:6823/30068","heartbeat_front_addr":"172.21.15.133:6821/30068","state":["exists","up"]},{"osd":3,"uuid":"614c2d45-f7b8-42e8-ba09-6e042a2358b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":30067},{"type":"v1","addr":"172.21.15.133:6801","nonce":30067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":30067},{"type":"v1","addr":"172.21.15.133:6803","nonce":30067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":30067},{"type":"v1","addr":"172.21.15.133:6807","nonce":30067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":30067},{"type":"v1","addr":"172.21.15.133:6805","nonce":30067}]},"public_addr":"172.21.15.133:6801/30067","cluster_addr":"172.21.15.133:6803/30067","heartbeat_back_addr":"172.21.15.133:6807/30067","heartbeat_front_addr":"172.21.15.133:6805/30067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.342817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.400384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.363652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.069618+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T01:56:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.716+0000 7f97e930e700 10 mgrc shutdown 2023-09-30T01:56:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.716+0000 7f97e930e700 1 -- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f97d008e8b0 msgr2=0x7f97d0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.716+0000 7f97e930e700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f97d008e8b0 0x7f97d0090d60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f97e40a3e10 tx=0x7f97d4007d30 comp rx=0 tx=0).stop 2023-09-30T01:56:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.716+0000 7f97e930e700 1 -- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97cc0051c0 msgr2=0x7f97e4147980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.716+0000 7f97e930e700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97cc0051c0 0x7f97e4147980 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f97d8006ac0 tx=0x7f97d80091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.716+0000 7f97e930e700 1 -- 172.21.15.55:0/4288828642 shutdown_connections 2023-09-30T01:56:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.716+0000 7f97e930e700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f97e4138c10 0x7f97e406cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.716+0000 7f97e930e700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f97e406e670 0x7f97e41386d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.716+0000 7f97e930e700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f97d008e8b0 0x7f97d0090d60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.716+0000 7f97e930e700 1 --2- 172.21.15.55:0/4288828642 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f97cc0051c0 0x7f97e4147980 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.716+0000 7f97e930e700 1 -- 172.21.15.55:0/4288828642 >> 172.21.15.55:0/4288828642 conn(0x7f97e40b23d0 msgr2=0x7f97e40a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.716+0000 7f97e930e700 1 -- 172.21.15.55:0/4288828642 shutdown_connections 2023-09-30T01:56:00.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.716+0000 7f97e930e700 1 -- 172.21.15.55:0/4288828642 wait complete. 2023-09-30T01:56:00.731 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-09-30T01:56:00.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.840+0000 7f813a810700 1 Processor -- start 2023-09-30T01:56:00.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.840+0000 7f813a810700 1 -- start start 2023-09-30T01:56:00.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a810700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8134067470 0x7f813406b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a810700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8134136750 0x7f813406b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a810700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81340a8e00 con 0x7f81340670a0 2023-09-30T01:56:00.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a810700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f813406b070 con 0x7f8134067470 2023-09-30T01:56:00.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a810700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81340a9290 con 0x7f8134136750 2023-09-30T01:56:00.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a00f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8134136750 0x7f813406b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a00f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8134136750 0x7f813406b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56948/0 (socket says 172.21.15.55:56948) 2023-09-30T01:56:00.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a00f700 1 -- 172.21.15.55:0/1558719169 learned_addr learned my addr 172.21.15.55:0/1558719169 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:00.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813900d700 1 --2- 172.21.15.55:0/1558719169 >> v2:172.21.15.133:3300/0 conn(0x7f8134067470 0x7f813406b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a00f700 1 -- 172.21.15.55:0/1558719169 >> v2:172.21.15.133:3300/0 conn(0x7f8134067470 msgr2=0x7f813406b330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:00.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a00f700 1 --2- 172.21.15.55:0/1558719169 >> v2:172.21.15.133:3300/0 conn(0x7f8134067470 0x7f813406b330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a00f700 1 -- 172.21.15.55:0/1558719169 >> v1:172.21.15.55:6789/0 conn(0x7f81340670a0 legacy=0x7f813406a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a00f700 1 -- 172.21.15.55:0/1558719169 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f813406ad20 con 0x7f8134136750 2023-09-30T01:56:00.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813900d700 1 --2- 172.21.15.55:0/1558719169 >> v2:172.21.15.133:3300/0 conn(0x7f8134067470 0x7f813406b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:56:00.848 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a00f700 1 --2- 172.21.15.55:0/1558719169 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8134136750 0x7f813406b870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f812c009f20 tx=0x7f812c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=384a7667e01e2f1a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:00.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813880c700 1 -- 172.21.15.55:0/1558719169 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c00e070 con 0x7f8134136750 2023-09-30T01:56:00.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813880c700 1 -- 172.21.15.55:0/1558719169 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c00ba80 con 0x7f8134136750 2023-09-30T01:56:00.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813880c700 1 -- 172.21.15.55:0/1558719169 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c0092e0 con 0x7f8134136750 2023-09-30T01:56:00.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a810700 1 -- 172.21.15.55:0/1558719169 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8134136750 msgr2=0x7f813406b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a810700 1 --2- 172.21.15.55:0/1558719169 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8134136750 0x7f813406b870 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f812c009f20 tx=0x7f812c009840 comp rx=0 tx=0).stop 2023-09-30T01:56:00.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a810700 1 -- 172.21.15.55:0/1558719169 shutdown_connections 2023-09-30T01:56:00.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a810700 1 --2- 172.21.15.55:0/1558719169 >> v2:172.21.15.133:3300/0 conn(0x7f8134067470 0x7f813406b330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a810700 1 --2- 172.21.15.55:0/1558719169 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8134136750 0x7f813406b870 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a810700 1 -- 172.21.15.55:0/1558719169 >> 172.21.15.55:0/1558719169 conn(0x7f81340b4530 msgr2=0x7f81340b4930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:00.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a810700 1 -- 172.21.15.55:0/1558719169 shutdown_connections 2023-09-30T01:56:00.850 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.844+0000 7f813a810700 1 -- 172.21.15.55:0/1558719169 wait complete. 2023-09-30T01:56:00.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813a810700 1 Processor -- start 2023-09-30T01:56:00.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813a810700 1 -- start start 2023-09-30T01:56:00.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813a810700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81340670a0 0x7f8134150030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813a810700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8134067470 0x7f81340aff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813a810700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8134136750 0x7f81340aae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813a810700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81340ac320 con 0x7f8134136750 2023-09-30T01:56:00.851 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813a810700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8134150a20 con 0x7f8134067470 2023-09-30T01:56:00.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813a810700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8134150ce0 con 0x7f81340670a0 2023-09-30T01:56:00.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813980e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81340670a0 0x7f8134150030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813980e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81340670a0 0x7f8134150030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56954/0 (socket says 172.21.15.55:56954) 2023-09-30T01:56:00.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813980e700 1 -- 172.21.15.55:0/2846156590 learned_addr learned my addr 172.21.15.55:0/2846156590 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:00.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813a00f700 1 --2- 172.21.15.55:0/2846156590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8134136750 0x7f81340aae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.852 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813900d700 1 --2- 172.21.15.55:0/2846156590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8134067470 0x7f81340aff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813980e700 1 -- 172.21.15.55:0/2846156590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8134067470 msgr2=0x7f81340aff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813980e700 1 --2- 172.21.15.55:0/2846156590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8134067470 0x7f81340aff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813980e700 1 -- 172.21.15.55:0/2846156590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8134136750 msgr2=0x7f81340aae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813980e700 1 --2- 172.21.15.55:0/2846156590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8134136750 0x7f81340aae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813980e700 1 -- 172.21.15.55:0/2846156590 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c009ae0 con 0x7f81340670a0 2023-09-30T01:56:00.853 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813980e700 1 --2- 172.21.15.55:0/2846156590 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81340670a0 0x7f8134150030 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f812400c7c0 tx=0x7f8124007f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f8129ffb700 1 -- 172.21.15.55:0/2846156590 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812400e4a0 con 0x7f81340670a0 2023-09-30T01:56:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f8129ffb700 1 -- 172.21.15.55:0/2846156590 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812400e620 con 0x7f81340670a0 2023-09-30T01:56:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813a810700 1 -- 172.21.15.55:0/2846156590 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8134151110 con 0x7f81340670a0 2023-09-30T01:56:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f8129ffb700 1 -- 172.21.15.55:0/2846156590 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812400e9e0 con 0x7f81340670a0 2023-09-30T01:56:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.848+0000 7f813a810700 1 -- 172.21.15.55:0/2846156590 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81341441e0 con 0x7f81340670a0 2023-09-30T01:56:00.854 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.852+0000 7f813a810700 1 -- 172.21.15.55:0/2846156590 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81340acda0 con 0x7f81340670a0 2023-09-30T01:56:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.852+0000 7f8129ffb700 1 -- 172.21.15.55:0/2846156590 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f812401b3b0 con 0x7f81340670a0 2023-09-30T01:56:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.852+0000 7f8129ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.852+0000 7f8129ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.852+0000 7f8129ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.852+0000 7f8129ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:00.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.852+0000 7f8129ffb700 1 --2- 172.21.15.55:0/2846156590 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f811808e860 0x7f8118090d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.852+0000 7f8129ffb700 1 -- 172.21.15.55:0/2846156590 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f81240b3cb0 con 0x7f81340670a0 2023-09-30T01:56:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.852+0000 7f813900d700 1 --2- 172.21.15.55:0/2846156590 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f811808e860 0x7f8118090d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:00.856 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.852+0000 7f813900d700 1 --2- 172.21.15.55:0/2846156590 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f811808e860 0x7f8118090d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8130006f00 tx=0x7f8130008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:00.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:00.860+0000 7f8129ffb700 1 -- 172.21.15.55:0/2846156590 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f81340acda0 con 0x7f81340670a0 2023-09-30T01:56:01.061 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.060+0000 7f813a810700 1 -- 172.21.15.55:0/2846156590 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f81340acda0 con 0x7f81340670a0 2023-09-30T01:56:01.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.140+0000 7f8129ffb700 1 -- 172.21.15.55:0/2846156590 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f81340acda0 con 0x7f81340670a0 2023-09-30T01:56:01.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.144+0000 7f813a810700 10 mgrc shutdown 2023-09-30T01:56:01.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.144+0000 7f813a810700 1 -- 172.21.15.55:0/2846156590 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f811808e860 msgr2=0x7f8118090d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:01.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.144+0000 7f813a810700 1 --2- 172.21.15.55:0/2846156590 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f811808e860 0x7f8118090d10 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f8130006f00 tx=0x7f8130008040 comp rx=0 tx=0).stop 2023-09-30T01:56:01.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.144+0000 7f813a810700 1 -- 172.21.15.55:0/2846156590 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81340670a0 msgr2=0x7f8134150030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:01.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.144+0000 7f813a810700 1 --2- 172.21.15.55:0/2846156590 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81340670a0 0x7f8134150030 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f812400c7c0 tx=0x7f8124007f00 comp rx=0 tx=0).stop 2023-09-30T01:56:01.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.144+0000 7f813a810700 1 -- 172.21.15.55:0/2846156590 shutdown_connections 2023-09-30T01:56:01.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.144+0000 7f813a810700 1 --2- 172.21.15.55:0/2846156590 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8134136750 0x7f81340aae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:01.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.144+0000 7f813a810700 1 --2- 172.21.15.55:0/2846156590 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8134067470 0x7f81340aff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:01.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.144+0000 7f813a810700 1 --2- 172.21.15.55:0/2846156590 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f811808e860 0x7f8118090d10 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:01.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.144+0000 7f813a810700 1 --2- 172.21.15.55:0/2846156590 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81340670a0 0x7f8134150030 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:01.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.144+0000 7f813a810700 1 -- 172.21.15.55:0/2846156590 >> 172.21.15.55:0/2846156590 conn(0x7f81340b4530 msgr2=0x7f81340b35b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:01.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.144+0000 7f813a810700 1 -- 172.21.15.55:0/2846156590 shutdown_connections 2023-09-30T01:56:01.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.144+0000 7f813a810700 1 -- 172.21.15.55:0/2846156590 wait complete. 2023-09-30T01:56:01.163 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-09-30T01:56:01.164 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-09-30T01:56:01.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.272+0000 7efe7e6c9700 1 Processor -- start 2023-09-30T01:56:01.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.272+0000 7efe7e6c9700 1 -- start start 2023-09-30T01:56:01.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.272+0000 7efe7e6c9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efe781498f0 0x7efe7814bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:01.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7e6c9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe780a5b90 con 0x7efe780a5760 2023-09-30T01:56:01.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7e6c9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe780a3e80 con 0x7efe780a5390 2023-09-30T01:56:01.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7e6c9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe780a99a0 con 0x7efe781498f0 2023-09-30T01:56:01.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe6ffff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efe780a5760 0x7efe78143bf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60248/0 (socket says 172.21.15.55:60248) 2023-09-30T01:56:01.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe6ffff700 1 -- 172.21.15.55:0/1260290898 learned_addr learned my addr 172.21.15.55:0/1260290898 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:01.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7cc66700 1 --2- 172.21.15.55:0/1260290898 >> v2:172.21.15.133:3300/0 conn(0x7efe781498f0 0x7efe7814bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:01.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe777fe700 1 -- 172.21.15.55:0/1260290898 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 19156041 0 0) 0x7efe780a5b90 con 0x7efe780a5760 2023-09-30T01:56:01.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe777fe700 1 -- 172.21.15.55:0/1260290898 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efe64003570 con 0x7efe780a5760 2023-09-30T01:56:01.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7cc66700 1 -- 172.21.15.55:0/1260290898 >> v1:172.21.15.133:6789/0 conn(0x7efe780a5390 legacy=0x7efe780a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:01.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7cc66700 1 -- 172.21.15.55:0/1260290898 >> v1:172.21.15.55:6789/0 conn(0x7efe780a5760 legacy=0x7efe78143bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:01.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe777fe700 1 -- 172.21.15.55:0/1260290898 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 505610980 0 0) 0x7efe64003570 con 0x7efe780a5760 2023-09-30T01:56:01.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7cc66700 1 -- 172.21.15.55:0/1260290898 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe78143570 con 0x7efe781498f0 2023-09-30T01:56:01.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7cc66700 1 --2- 172.21.15.55:0/1260290898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe781498f0 0x7efe7814bcd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efe70009e60 tx=0x7efe70009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=52b7861f52b03f0d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:01.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe777fe700 1 -- 172.21.15.55:0/1260290898 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7000e070 con 0x7efe781498f0 2023-09-30T01:56:01.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe777fe700 1 -- 172.21.15.55:0/1260290898 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe7000bbf0 con 0x7efe781498f0 2023-09-30T01:56:01.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe777fe700 1 -- 172.21.15.55:0/1260290898 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70012430 con 0x7efe781498f0 2023-09-30T01:56:01.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7e6c9700 1 -- 172.21.15.55:0/1260290898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe781498f0 msgr2=0x7efe7814bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:01.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7e6c9700 1 --2- 172.21.15.55:0/1260290898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe781498f0 0x7efe7814bcd0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7efe70009e60 tx=0x7efe70009780 comp rx=0 tx=0).stop 2023-09-30T01:56:01.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7e6c9700 1 -- 172.21.15.55:0/1260290898 shutdown_connections 2023-09-30T01:56:01.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7e6c9700 1 --2- 172.21.15.55:0/1260290898 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe781498f0 0x7efe7814bcd0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:01.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7e6c9700 1 -- 172.21.15.55:0/1260290898 >> 172.21.15.55:0/1260290898 conn(0x7efe780b6860 msgr2=0x7efe780b6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:01.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7e6c9700 1 -- 172.21.15.55:0/1260290898 shutdown_connections 2023-09-30T01:56:01.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.276+0000 7efe7e6c9700 1 -- 172.21.15.55:0/1260290898 wait complete. 2023-09-30T01:56:01.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe7e6c9700 1 Processor -- start 2023-09-30T01:56:01.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe7e6c9700 1 -- start start 2023-09-30T01:56:01.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe7e6c9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe780a5390 0x7efe7813e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:01.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe7e6c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe780a5760 0x7efe78144b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:01.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe7e6c9700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe781498f0 0x7efe7813afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:01.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe7e6c9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7806ebb0 con 0x7efe780a5390 2023-09-30T01:56:01.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe7e6c9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe7806b5c0 con 0x7efe780a5760 2023-09-30T01:56:01.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe7e6c9700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe78145530 con 0x7efe781498f0 2023-09-30T01:56:01.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe77fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe780a5390 0x7efe7813e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:01.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe7cc66700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe781498f0 0x7efe7813afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:01.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe77fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe780a5390 0x7efe7813e6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:58034/0 (socket says 172.21.15.55:58034) 2023-09-30T01:56:01.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe77fff700 1 -- 172.21.15.55:0/3765656605 learned_addr learned my addr 172.21.15.55:0/3765656605 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:01.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe6ffff700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe780a5760 0x7efe78144b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe7cc66700 1 -- 172.21.15.55:0/3765656605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe780a5760 msgr2=0x7efe78144b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe7cc66700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe780a5760 0x7efe78144b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:01.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe7cc66700 1 -- 172.21.15.55:0/3765656605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe780a5390 msgr2=0x7efe7813e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:01.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe7cc66700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe780a5390 0x7efe7813e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:01.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe7cc66700 1 -- 172.21.15.55:0/3765656605 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe70009a20 con 0x7efe781498f0 2023-09-30T01:56:01.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe77fff700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe780a5390 0x7efe7813e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:01.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.280+0000 7efe6ffff700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe780a5760 0x7efe78144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:01.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.284+0000 7efe7cc66700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe781498f0 0x7efe7813afa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efe70016000 tx=0x7efe70019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:01.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.284+0000 7efe74ff9700 1 -- 172.21.15.55:0/3765656605 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70026480 con 0x7efe781498f0 2023-09-30T01:56:01.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.284+0000 7efe74ff9700 1 -- 172.21.15.55:0/3765656605 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70026620 con 0x7efe781498f0 2023-09-30T01:56:01.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.284+0000 7efe7e6c9700 1 -- 172.21.15.55:0/3765656605 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe781457f0 con 0x7efe781498f0 2023-09-30T01:56:01.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.284+0000 7efe74ff9700 1 -- 172.21.15.55:0/3765656605 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe700269e0 con 0x7efe781498f0 2023-09-30T01:56:01.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.284+0000 7efe7e6c9700 1 -- 172.21.15.55:0/3765656605 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe781450a0 con 0x7efe781498f0 2023-09-30T01:56:01.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.284+0000 7efe7e6c9700 1 -- 172.21.15.55:0/3765656605 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe78145290 con 0x7efe781498f0 2023-09-30T01:56:01.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.288+0000 7efe74ff9700 1 -- 172.21.15.55:0/3765656605 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7efe7001c400 con 0x7efe781498f0 2023-09-30T01:56:01.290 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.288+0000 7efe74ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:01.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.288+0000 7efe74ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:01.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.288+0000 7efe74ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:01.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.288+0000 7efe74ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:01.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.288+0000 7efe74ff9700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7efe5808e8b0 0x7efe58090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:01.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.288+0000 7efe74ff9700 1 -- 172.21.15.55:0/3765656605 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7efe700b6df0 con 0x7efe781498f0 2023-09-30T01:56:01.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.288+0000 7efe77fff700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7efe5808e8b0 0x7efe58090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:01.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.288+0000 7efe77fff700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7efe5808e8b0 0x7efe58090d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efe68001e90 tx=0x7efe68009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:01.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.292+0000 7efe74ff9700 1 -- 172.21.15.55:0/3765656605 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efe70087810 con 0x7efe781498f0 2023-09-30T01:56:01.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:01.496+0000 7efe7e6c9700 1 -- 172.21.15.55:0/3765656605 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7efe78065180 con 0x7efe781498f0 2023-09-30T01:56:01.728 INFO:tasks.ceph.mds.b.smithi133.stderr:2023-09-30T01:56:01.724+0000 7f5873f3c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-09-30T01:56:02.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.152+0000 7efe74ff9700 1 -- 172.21.15.55:0/3765656605 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7efe7008ae30 con 0x7efe781498f0 2023-09-30T01:56:02.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.156+0000 7efe7e6c9700 10 mgrc shutdown 2023-09-30T01:56:02.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.156+0000 7efe7e6c9700 1 -- 172.21.15.55:0/3765656605 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7efe5808e8b0 msgr2=0x7efe58090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.156+0000 7efe7e6c9700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7efe5808e8b0 0x7efe58090d60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efe68001e90 tx=0x7efe68009040 comp rx=0 tx=0).stop 2023-09-30T01:56:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.156+0000 7efe7e6c9700 1 -- 172.21.15.55:0/3765656605 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe781498f0 msgr2=0x7efe7813afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.156+0000 7efe7e6c9700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe781498f0 0x7efe7813afa0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7efe70016000 tx=0x7efe70019000 comp rx=0 tx=0).stop 2023-09-30T01:56:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.156+0000 7efe7e6c9700 1 -- 172.21.15.55:0/3765656605 shutdown_connections 2023-09-30T01:56:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.156+0000 7efe7e6c9700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7efe5808e8b0 0x7efe58090d60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.156+0000 7efe7e6c9700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efe781498f0 0x7efe7813afa0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.156+0000 7efe7e6c9700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efe780a5760 0x7efe78144b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.156+0000 7efe7e6c9700 1 --2- 172.21.15.55:0/3765656605 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efe780a5390 0x7efe7813e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.156+0000 7efe7e6c9700 1 -- 172.21.15.55:0/3765656605 >> 172.21.15.55:0/3765656605 conn(0x7efe780b6860 msgr2=0x7efe781491a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.156+0000 7efe7e6c9700 1 -- 172.21.15.55:0/3765656605 shutdown_connections 2023-09-30T01:56:02.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.156+0000 7efe7e6c9700 1 -- 172.21.15.55:0/3765656605 wait complete. 2023-09-30T01:56:02.175 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-09-30T01:56:02.175 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-09-30T01:56:02.291 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d26cf0700 1 Processor -- start 2023-09-30T01:56:02.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d26cf0700 1 -- start start 2023-09-30T01:56:02.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d26cf0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d200b3060 0x7f9d2006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d26cf0700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2006daf0 con 0x7f9d2013a400 2023-09-30T01:56:02.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d26cf0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2006d910 con 0x7f9d201481d0 2023-09-30T01:56:02.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d26cf0700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d201489d0 con 0x7f9d200b3060 2023-09-30T01:56:02.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d24a8c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d200b3060 0x7f9d2006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d24a8c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d200b3060 0x7f9d2006d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43604/0 (socket says 172.21.15.55:43604) 2023-09-30T01:56:02.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d24a8c700 1 -- 172.21.15.55:0/739319131 learned_addr learned my addr 172.21.15.55:0/739319131 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:02.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d24a8c700 1 -- 172.21.15.55:0/739319131 >> v1:172.21.15.133:6789/0 conn(0x7f9d201481d0 legacy=0x7f9d2014ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:02.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d24a8c700 1 -- 172.21.15.55:0/739319131 >> v1:172.21.15.55:6789/0 conn(0x7f9d2013a400 legacy=0x7f9d20147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d24a8c700 1 -- 172.21.15.55:0/739319131 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d200b3430 con 0x7f9d200b3060 2023-09-30T01:56:02.293 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d24a8c700 1 --2- 172.21.15.55:0/739319131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d200b3060 0x7f9d2006d3d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d20148b10 tx=0x7f9d10009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4de6bd3197aeab5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:02.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d1f7fe700 1 -- 172.21.15.55:0/739319131 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000b820 con 0x7f9d200b3060 2023-09-30T01:56:02.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d1f7fe700 1 -- 172.21.15.55:0/739319131 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1000b980 con 0x7f9d200b3060 2023-09-30T01:56:02.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d1f7fe700 1 -- 172.21.15.55:0/739319131 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1000bd20 con 0x7f9d200b3060 2023-09-30T01:56:02.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d26cf0700 1 -- 172.21.15.55:0/739319131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d200b3060 msgr2=0x7f9d2006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d26cf0700 1 --2- 172.21.15.55:0/739319131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d200b3060 0x7f9d2006d3d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9d20148b10 tx=0x7f9d10009250 comp rx=0 tx=0).stop 2023-09-30T01:56:02.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d26cf0700 1 -- 172.21.15.55:0/739319131 shutdown_connections 2023-09-30T01:56:02.294 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d26cf0700 1 --2- 172.21.15.55:0/739319131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d200b3060 0x7f9d2006d3d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d26cf0700 1 -- 172.21.15.55:0/739319131 >> 172.21.15.55:0/739319131 conn(0x7f9d20068b00 msgr2=0x7f9d200b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:02.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d26cf0700 1 -- 172.21.15.55:0/739319131 shutdown_connections 2023-09-30T01:56:02.295 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.288+0000 7f9d26cf0700 1 -- 172.21.15.55:0/739319131 wait complete. 2023-09-30T01:56:02.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d26cf0700 1 Processor -- start 2023-09-30T01:56:02.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d26cf0700 1 -- start start 2023-09-30T01:56:02.296 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d26cf0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d200b3060 0x7f9d200ad3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d26cf0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d2013a400 0x7f9d20154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d26cf0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d201481d0 0x7f9d200abd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d26cf0700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200acef0 con 0x7f9d200b3060 2023-09-30T01:56:02.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d26cf0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200adde0 con 0x7f9d2013a400 2023-09-30T01:56:02.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d26cf0700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d20154ee0 con 0x7f9d201481d0 2023-09-30T01:56:02.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d24a8c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d200b3060 0x7f9d200ad3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d2528d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d201481d0 0x7f9d200abd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d24a8c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d200b3060 0x7f9d200ad3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39780/0 (socket says 172.21.15.55:39780) 2023-09-30T01:56:02.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d24a8c700 1 -- 172.21.15.55:0/1419837297 learned_addr learned my addr 172.21.15.55:0/1419837297 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:02.297 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d1ffff700 1 --2- 172.21.15.55:0/1419837297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d2013a400 0x7f9d20154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d24a8c700 1 -- 172.21.15.55:0/1419837297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d201481d0 msgr2=0x7f9d200abd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d24a8c700 1 --2- 172.21.15.55:0/1419837297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d201481d0 0x7f9d200abd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d24a8c700 1 -- 172.21.15.55:0/1419837297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d2013a400 msgr2=0x7f9d20154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d24a8c700 1 --2- 172.21.15.55:0/1419837297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d2013a400 0x7f9d20154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d24a8c700 1 -- 172.21.15.55:0/1419837297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d100094f0 con 0x7f9d200b3060 2023-09-30T01:56:02.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.292+0000 7f9d2528d700 1 --2- 172.21.15.55:0/1419837297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d201481d0 0x7f9d200abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:02.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.296+0000 7f9d24a8c700 1 --2- 172.21.15.55:0/1419837297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d200b3060 0x7f9d200ad3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9d10009930 tx=0x7f9d10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:02.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.296+0000 7f9d1cff9700 1 -- 172.21.15.55:0/1419837297 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d10011e40 con 0x7f9d200b3060 2023-09-30T01:56:02.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.296+0000 7f9d1cff9700 1 -- 172.21.15.55:0/1419837297 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1001a420 con 0x7f9d200b3060 2023-09-30T01:56:02.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.296+0000 7f9d26cf0700 1 -- 172.21.15.55:0/1419837297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d201551a0 con 0x7f9d200b3060 2023-09-30T01:56:02.300 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.296+0000 7f9d1cff9700 1 -- 172.21.15.55:0/1419837297 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1001a7e0 con 0x7f9d200b3060 2023-09-30T01:56:02.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.296+0000 7f9d26cf0700 1 -- 172.21.15.55:0/1419837297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d200ad930 con 0x7f9d200b3060 2023-09-30T01:56:02.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.296+0000 7f9d26cf0700 1 -- 172.21.15.55:0/1419837297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d20068300 con 0x7f9d200b3060 2023-09-30T01:56:02.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.296+0000 7f9d1cff9700 1 -- 172.21.15.55:0/1419837297 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f9d1001ab50 con 0x7f9d200b3060 2023-09-30T01:56:02.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.296+0000 7f9d1cff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:02.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.300+0000 7f9d1cff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:02.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.300+0000 7f9d1cff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:02.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.300+0000 7f9d1cff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:02.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.300+0000 7f9d1cff9700 1 --2- 172.21.15.55:0/1419837297 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9d0c08e8b0 0x7f9d0c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.300+0000 7f9d1ffff700 1 --2- 172.21.15.55:0/1419837297 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9d0c08e8b0 0x7f9d0c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.300+0000 7f9d1cff9700 1 -- 172.21.15.55:0/1419837297 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f9d100b61f0 con 0x7f9d200b3060 2023-09-30T01:56:02.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.300+0000 7f9d1ffff700 1 --2- 172.21.15.55:0/1419837297 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9d0c08e8b0 0x7f9d0c090d60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d200af890 tx=0x7f9d14009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:02.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.308+0000 7f9d1cff9700 1 -- 172.21.15.55:0/1419837297 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9d10086c10 con 0x7f9d200b3060 2023-09-30T01:56:02.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.496+0000 7f9d26cf0700 1 -- 172.21.15.55:0/1419837297 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d20148710 con 0x7f9d200b3060 2023-09-30T01:56:02.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.500+0000 7f9d1cff9700 1 -- 172.21.15.55:0/1419837297 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+3838 (secure 0 0 0) 0x7f9d10015090 con 0x7f9d200b3060 2023-09-30T01:56:02.501 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:02.501 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4202,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6811/2430010052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6810","nonce":2430010052},{"type":"v1","addr":"172.21.15.55:6811","nonce":2430010052}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4208,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.55:6813/2133827295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6812","nonce":2133827295},{"type":"v1","addr":"172.21.15.55:6813","nonce":2133827295}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-09-30T01:56:00.103067+0000","modified":"2023-09-30T01:56:02.139154+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4258},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4258":{"gid":4258,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.133:6825/2206089193","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6824","nonce":2206089193},{"type":"v1","addr":"172.21.15.133:6825","nonce":2206089193}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-09-30T01:56:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.500+0000 7f9d26cf0700 10 mgrc shutdown 2023-09-30T01:56:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.500+0000 7f9d26cf0700 1 -- 172.21.15.55:0/1419837297 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9d0c08e8b0 msgr2=0x7f9d0c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.500+0000 7f9d26cf0700 1 --2- 172.21.15.55:0/1419837297 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9d0c08e8b0 0x7f9d0c090d60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d200af890 tx=0x7f9d14009040 comp rx=0 tx=0).stop 2023-09-30T01:56:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.500+0000 7f9d26cf0700 1 -- 172.21.15.55:0/1419837297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d200b3060 msgr2=0x7f9d200ad3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.500+0000 7f9d26cf0700 1 --2- 172.21.15.55:0/1419837297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d200b3060 0x7f9d200ad3f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9d10009930 tx=0x7f9d10017000 comp rx=0 tx=0).stop 2023-09-30T01:56:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.500+0000 7f9d26cf0700 1 -- 172.21.15.55:0/1419837297 shutdown_connections 2023-09-30T01:56:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.500+0000 7f9d26cf0700 1 --2- 172.21.15.55:0/1419837297 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9d0c08e8b0 0x7f9d0c090d60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.500+0000 7f9d26cf0700 1 --2- 172.21.15.55:0/1419837297 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9d201481d0 0x7f9d200abd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.500+0000 7f9d26cf0700 1 --2- 172.21.15.55:0/1419837297 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9d2013a400 0x7f9d20154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.500+0000 7f9d26cf0700 1 --2- 172.21.15.55:0/1419837297 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9d200b3060 0x7f9d200ad3f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.500+0000 7f9d26cf0700 1 -- 172.21.15.55:0/1419837297 >> 172.21.15.55:0/1419837297 conn(0x7f9d20068b00 msgr2=0x7f9d200a4df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:02.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.500+0000 7f9d26cf0700 1 -- 172.21.15.55:0/1419837297 shutdown_connections 2023-09-30T01:56:02.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.500+0000 7f9d26cf0700 1 -- 172.21.15.55:0/1419837297 wait complete. 2023-09-30T01:56:02.505 INFO:teuthology.orchestra.run.smithi055.stderr:dumped fsmap epoch 6 2023-09-30T01:56:02.516 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T01:56:02.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fddc03700 1 Processor -- start 2023-09-30T01:56:02.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fddc03700 1 -- start start 2023-09-30T01:56:02.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fddc03700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2fd80a59a0 0x7f2fd80af6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fddc03700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd8140ec0 con 0x7f2fd80a55d0 2023-09-30T01:56:02.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fddc03700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fd8141180 con 0x7f2fd8133400 2023-09-30T01:56:02.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fddc03700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2fd80a7180 con 0x7f2fd80a59a0 2023-09-30T01:56:02.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fd77fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2fd80a55d0 0x7f2fd80a66e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53100/0 (socket says 172.21.15.55:53100) 2023-09-30T01:56:02.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fd77fe700 1 -- 172.21.15.55:0/4075545069 learned_addr learned my addr 172.21.15.55:0/4075545069 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:02.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fd6ffd700 1 --2- 172.21.15.55:0/4075545069 >> v2:172.21.15.133:3300/0 conn(0x7f2fd80a59a0 0x7f2fd80af6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fd67fc700 1 -- 172.21.15.55:0/4075545069 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1703460278 0 0) 0x7f2fd8140ec0 con 0x7f2fd80a55d0 2023-09-30T01:56:02.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fd67fc700 1 -- 172.21.15.55:0/4075545069 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fc0003570 con 0x7f2fd80a55d0 2023-09-30T01:56:02.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fd6ffd700 1 -- 172.21.15.55:0/4075545069 >> v1:172.21.15.133:6789/0 conn(0x7f2fd8133400 legacy=0x7f2fd8140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fd67fc700 1 -- 172.21.15.55:0/4075545069 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 941845361 0 0) 0x7f2fd8141180 con 0x7f2fd8133400 2023-09-30T01:56:02.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fd6ffd700 1 -- 172.21.15.55:0/4075545069 >> v1:172.21.15.55:6789/0 conn(0x7f2fd80a55d0 legacy=0x7f2fd80a66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fd6ffd700 1 -- 172.21.15.55:0/4075545069 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fd8140a90 con 0x7f2fd80a59a0 2023-09-30T01:56:02.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.616+0000 7f2fd6ffd700 1 --2- 172.21.15.55:0/4075545069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd80a59a0 0x7f2fd80af6b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80098e0 tx=0x7f2fc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1d8ef3b63209363a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:02.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fd67fc700 1 -- 172.21.15.55:0/4075545069 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fcc001470 con 0x7f2fd80a59a0 2023-09-30T01:56:02.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fd67fc700 1 -- 172.21.15.55:0/4075545069 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fc8011420 con 0x7f2fd80a59a0 2023-09-30T01:56:02.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fd67fc700 1 -- 172.21.15.55:0/4075545069 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fc80117c0 con 0x7f2fd80a59a0 2023-09-30T01:56:02.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 -- 172.21.15.55:0/4075545069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd80a59a0 msgr2=0x7f2fd80af6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 --2- 172.21.15.55:0/4075545069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd80a59a0 0x7f2fd80af6b0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2fc80098e0 tx=0x7f2fc80091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 -- 172.21.15.55:0/4075545069 shutdown_connections 2023-09-30T01:56:02.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 --2- 172.21.15.55:0/4075545069 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd80a59a0 0x7f2fd80af6b0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 -- 172.21.15.55:0/4075545069 >> 172.21.15.55:0/4075545069 conn(0x7f2fd8068b00 msgr2=0x7f2fd80b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:02.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 -- 172.21.15.55:0/4075545069 shutdown_connections 2023-09-30T01:56:02.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 -- 172.21.15.55:0/4075545069 wait complete. 2023-09-30T01:56:02.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 Processor -- start 2023-09-30T01:56:02.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 -- start start 2023-09-30T01:56:02.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd80a55d0 0x7f2fd80af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd80a59a0 0x7f2fd8133f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fd8133400 0x7f2fd812e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd81356a0 con 0x7f2fd80a55d0 2023-09-30T01:56:02.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd8135960 con 0x7f2fd80a59a0 2023-09-30T01:56:02.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fddc03700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fd8134470 con 0x7f2fd8133400 2023-09-30T01:56:02.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fd77fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd80a55d0 0x7f2fd80af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fd7fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fd8133400 0x7f2fd812e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.620+0000 7f2fd77fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd80a55d0 0x7f2fd80af130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39788/0 (socket says 172.21.15.55:39788) 2023-09-30T01:56:02.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fd77fe700 1 -- 172.21.15.55:0/1487962807 learned_addr learned my addr 172.21.15.55:0/1487962807 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:02.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fd6ffd700 1 --2- 172.21.15.55:0/1487962807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd80a59a0 0x7f2fd8133f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fd7fff700 1 -- 172.21.15.55:0/1487962807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd80a59a0 msgr2=0x7f2fd8133f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fd7fff700 1 --2- 172.21.15.55:0/1487962807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd80a59a0 0x7f2fd8133f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fd7fff700 1 -- 172.21.15.55:0/1487962807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd80a55d0 msgr2=0x7f2fd80af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fd7fff700 1 --2- 172.21.15.55:0/1487962807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd80a55d0 0x7f2fd80af130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fd7fff700 1 -- 172.21.15.55:0/1487962807 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fc8009420 con 0x7f2fd8133400 2023-09-30T01:56:02.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fd77fe700 1 --2- 172.21.15.55:0/1487962807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd80a55d0 0x7f2fd80af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:02.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fd7fff700 1 --2- 172.21.15.55:0/1487962807 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fd8133400 0x7f2fd812e840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8133800 tx=0x7f2fd00015f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:02.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fbf7fe700 1 -- 172.21.15.55:0/1487962807 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0011590 con 0x7f2fd8133400 2023-09-30T01:56:02.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fbf7fe700 1 -- 172.21.15.55:0/1487962807 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fd00116f0 con 0x7f2fd8133400 2023-09-30T01:56:02.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fbf7fe700 1 -- 172.21.15.55:0/1487962807 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0011ab0 con 0x7f2fd8133400 2023-09-30T01:56:02.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fddc03700 1 -- 172.21.15.55:0/1487962807 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fd80a8c20 con 0x7f2fd8133400 2023-09-30T01:56:02.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fddc03700 1 -- 172.21.15.55:0/1487962807 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fd8135470 con 0x7f2fd8133400 2023-09-30T01:56:02.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.624+0000 7f2fddc03700 1 -- 172.21.15.55:0/1487962807 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fd8068300 con 0x7f2fd8133400 2023-09-30T01:56:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.628+0000 7f2fbf7fe700 1 -- 172.21.15.55:0/1487962807 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f2fd0025430 con 0x7f2fd8133400 2023-09-30T01:56:02.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.628+0000 7f2fbf7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:02.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.628+0000 7f2fbf7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.628+0000 7f2fbf7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.628+0000 7f2fbf7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.628+0000 7f2fbf7fe700 1 --2- 172.21.15.55:0/1487962807 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2fc408e8b0 0x7f2fc4090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.628+0000 7f2fd77fe700 1 --2- 172.21.15.55:0/1487962807 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2fc408e8b0 0x7f2fc4090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.628+0000 7f2fbf7fe700 1 -- 172.21.15.55:0/1487962807 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f2fd00b5060 con 0x7f2fd8133400 2023-09-30T01:56:02.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.628+0000 7f2fd77fe700 1 --2- 172.21.15.55:0/1487962807 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2fc408e8b0 0x7f2fc4090d60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0011e0 tx=0x7f2fcc000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:02.637 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.636+0000 7f2fbf7fe700 1 -- 172.21.15.55:0/1487962807 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2fd00859f0 con 0x7f2fd8133400 2023-09-30T01:56:02.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.796+0000 7f2fddc03700 1 -- 172.21.15.55:0/1487962807 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2fd81345b0 con 0x7f2fd8133400 2023-09-30T01:56:02.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.796+0000 7f2fbf7fe700 1 -- 172.21.15.55:0/1487962807 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12194 (secure 0 0 0) 0x7f2fd00b3e60 con 0x7f2fd8133400 2023-09-30T01:56:02.800 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:02.800 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"fsid":"37496c89-c485-46e5-8550-5722d2abf46a","created":"2023-09-30T01:55:38.697831+0000","modified":"2023-09-30T01:56:01.106295+0000","last_up_change":"2023-09-30T01:55:48.191927+0000","last_in_change":"2023-09-30T01:55:39.813210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T01:55:49.090600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T01:55:54.370944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T01:55:58.474504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T01:55:59.107639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27634},{"type":"v1","addr":"172.21.15.55:6801","nonce":27634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27634},{"type":"v1","addr":"172.21.15.55:6803","nonce":27634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27634},{"type":"v1","addr":"172.21.15.55:6807","nonce":27634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27634},{"type":"v1","addr":"172.21.15.55:6805","nonce":27634}]},"public_addr":"172.21.15.55:6801/27634","cluster_addr":"172.21.15.55:6803/27634","heartbeat_back_addr":"172.21.15.55:6807/27634","heartbeat_front_addr":"172.21.15.55:6805/27634","state":["exists","up"]},{"osd":1,"uuid":"b52b4f6f-00aa-4ef8-b3d4-467475cd0bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":30066},{"type":"v1","addr":"172.21.15.133:6809","nonce":30066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":30066},{"type":"v1","addr":"172.21.15.133:6811","nonce":30066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":30066},{"type":"v1","addr":"172.21.15.133:6815","nonce":30066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":30066},{"type":"v1","addr":"172.21.15.133:6813","nonce":30066}]},"public_addr":"172.21.15.133:6809/30066","cluster_addr":"172.21.15.133:6811/30066","heartbeat_back_addr":"172.21.15.133:6815/30066","heartbeat_front_addr":"172.21.15.133:6813/30066","state":["exists","up"]},{"osd":2,"uuid":"c48b2c87-a33c-47fc-8b84-e64faad378b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":30068},{"type":"v1","addr":"172.21.15.133:6817","nonce":30068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":30068},{"type":"v1","addr":"172.21.15.133:6819","nonce":30068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":30068},{"type":"v1","addr":"172.21.15.133:6823","nonce":30068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":30068},{"type":"v1","addr":"172.21.15.133:6821","nonce":30068}]},"public_addr":"172.21.15.133:6817/30068","cluster_addr":"172.21.15.133:6819/30068","heartbeat_back_addr":"172.21.15.133:6823/30068","heartbeat_front_addr":"172.21.15.133:6821/30068","state":["exists","up"]},{"osd":3,"uuid":"614c2d45-f7b8-42e8-ba09-6e042a2358b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":30067},{"type":"v1","addr":"172.21.15.133:6801","nonce":30067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":30067},{"type":"v1","addr":"172.21.15.133:6803","nonce":30067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":30067},{"type":"v1","addr":"172.21.15.133:6807","nonce":30067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":30067},{"type":"v1","addr":"172.21.15.133:6805","nonce":30067}]},"public_addr":"172.21.15.133:6801/30067","cluster_addr":"172.21.15.133:6803/30067","heartbeat_back_addr":"172.21.15.133:6807/30067","heartbeat_front_addr":"172.21.15.133:6805/30067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.342817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.400384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.363652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.069618+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T01:56:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.800+0000 7f2fddc03700 10 mgrc shutdown 2023-09-30T01:56:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.800+0000 7f2fddc03700 1 -- 172.21.15.55:0/1487962807 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2fc408e8b0 msgr2=0x7f2fc4090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.800+0000 7f2fddc03700 1 --2- 172.21.15.55:0/1487962807 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2fc408e8b0 0x7f2fc4090d60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc0011e0 tx=0x7f2fcc000bc0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.800+0000 7f2fddc03700 1 -- 172.21.15.55:0/1487962807 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fd8133400 msgr2=0x7f2fd812e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.800+0000 7f2fddc03700 1 --2- 172.21.15.55:0/1487962807 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fd8133400 0x7f2fd812e840 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2fd8133800 tx=0x7f2fd00015f0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.800+0000 7f2fddc03700 1 -- 172.21.15.55:0/1487962807 shutdown_connections 2023-09-30T01:56:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.800+0000 7f2fddc03700 1 --2- 172.21.15.55:0/1487962807 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2fc408e8b0 0x7f2fc4090d60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.800+0000 7f2fddc03700 1 --2- 172.21.15.55:0/1487962807 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2fd8133400 0x7f2fd812e840 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.805 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.800+0000 7f2fddc03700 1 --2- 172.21.15.55:0/1487962807 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2fd80a59a0 0x7f2fd8133f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.800+0000 7f2fddc03700 1 --2- 172.21.15.55:0/1487962807 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2fd80a55d0 0x7f2fd80af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.800+0000 7f2fddc03700 1 -- 172.21.15.55:0/1487962807 >> 172.21.15.55:0/1487962807 conn(0x7f2fd8068b00 msgr2=0x7f2fd806b660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:02.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.800+0000 7f2fddc03700 1 -- 172.21.15.55:0/1487962807 shutdown_connections 2023-09-30T01:56:02.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.800+0000 7f2fddc03700 1 -- 172.21.15.55:0/1487962807 wait complete. 2023-09-30T01:56:02.821 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-09-30T01:56:02.822 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T01:56:02.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74297fe700 1 Processor -- start 2023-09-30T01:56:02.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74297fe700 1 -- start start 2023-09-30T01:56:02.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74297fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74240a4d60 0x7f74240aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74297fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f742413a750 0x7f742409f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74297fe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74240af120 con 0x7f74240a4990 2023-09-30T01:56:02.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74297fe700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f742409f8b0 con 0x7f742413a750 2023-09-30T01:56:02.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74297fe700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74240af5b0 con 0x7f74240a4d60 2023-09-30T01:56:02.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74237fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74240a4d60 0x7f74240aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74237fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74240a4d60 0x7f74240aeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43634/0 (socket says 172.21.15.55:43634) 2023-09-30T01:56:02.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f7428ffd700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f742413a750 0x7f742409f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74237fe700 1 -- 172.21.15.55:0/2567750381 learned_addr learned my addr 172.21.15.55:0/2567750381 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:02.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74237fe700 1 -- 172.21.15.55:0/2567750381 >> v2:172.21.15.133:3300/0 conn(0x7f742413a750 msgr2=0x7f742409f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:02.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74237fe700 1 --2- 172.21.15.55:0/2567750381 >> v2:172.21.15.133:3300/0 conn(0x7f742413a750 0x7f742409f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74237fe700 1 -- 172.21.15.55:0/2567750381 >> v1:172.21.15.133:6789/0 conn(0x7f74240a4990 legacy=0x7f74240a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74237fe700 1 -- 172.21.15.55:0/2567750381 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742409fb10 con 0x7f74240a4d60 2023-09-30T01:56:02.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f7428ffd700 1 --2- 172.21.15.55:0/2567750381 >> v2:172.21.15.133:3300/0 conn(0x7f742413a750 0x7f742409f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:02.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f74237fe700 1 --2- 172.21.15.55:0/2567750381 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74240a4d60 0x7f74240aeb90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f74180099b0 tx=0x7f7418009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae1a676fd692f627 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:02.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f7422ffd700 1 -- 172.21.15.55:0/2567750381 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7418009ea0 con 0x7f74240a4d60 2023-09-30T01:56:02.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f7422ffd700 1 -- 172.21.15.55:0/2567750381 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741800b860 con 0x7f74240a4d60 2023-09-30T01:56:02.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.924+0000 7f7422ffd700 1 -- 172.21.15.55:0/2567750381 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741800bc00 con 0x7f74240a4d60 2023-09-30T01:56:02.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 -- 172.21.15.55:0/2567750381 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74240a4d60 msgr2=0x7f74240aeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 --2- 172.21.15.55:0/2567750381 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74240a4d60 0x7f74240aeb90 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f74180099b0 tx=0x7f7418009250 comp rx=0 tx=0).stop 2023-09-30T01:56:02.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 -- 172.21.15.55:0/2567750381 shutdown_connections 2023-09-30T01:56:02.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 --2- 172.21.15.55:0/2567750381 >> v2:172.21.15.133:3300/0 conn(0x7f742413a750 0x7f742409f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 --2- 172.21.15.55:0/2567750381 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74240a4d60 0x7f74240aeb90 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 -- 172.21.15.55:0/2567750381 >> 172.21.15.55:0/2567750381 conn(0x7f74240b23d0 msgr2=0x7f74240b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:02.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 -- 172.21.15.55:0/2567750381 shutdown_connections 2023-09-30T01:56:02.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 -- 172.21.15.55:0/2567750381 wait complete. 2023-09-30T01:56:02.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 Processor -- start 2023-09-30T01:56:02.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 -- start start 2023-09-30T01:56:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74240a4990 0x7f7424099010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74240a4d60 0x7f742406e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f742413a750 0x7f742406e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f742406eb60 con 0x7f74240a4990 2023-09-30T01:56:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7424098670 con 0x7f742413a750 2023-09-30T01:56:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74297fe700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7424148bb0 con 0x7f74240a4d60 2023-09-30T01:56:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f7423fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74240a4990 0x7f7424099010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f74237fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74240a4d60 0x7f742406e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f7423fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74240a4990 0x7f7424099010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39802/0 (socket says 172.21.15.55:39802) 2023-09-30T01:56:02.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f7423fff700 1 -- 172.21.15.55:0/3267917348 learned_addr learned my addr 172.21.15.55:0/3267917348 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:02.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f7428ffd700 1 --2- 172.21.15.55:0/3267917348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f742413a750 0x7f742406e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f7423fff700 1 -- 172.21.15.55:0/3267917348 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74240a4d60 msgr2=0x7f742406e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f7423fff700 1 --2- 172.21.15.55:0/3267917348 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74240a4d60 0x7f742406e0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f7423fff700 1 -- 172.21.15.55:0/3267917348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f742413a750 msgr2=0x7f742406e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:02.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f7423fff700 1 --2- 172.21.15.55:0/3267917348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f742413a750 0x7f742406e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:02.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.928+0000 7f7423fff700 1 -- 172.21.15.55:0/3267917348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7414009420 con 0x7f74240a4990 2023-09-30T01:56:02.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.932+0000 7f7423fff700 1 --2- 172.21.15.55:0/3267917348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74240a4990 0x7f7424099010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f741c00c8e0 tx=0x7f741c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:02.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.932+0000 7f740bfff700 1 -- 172.21.15.55:0/3267917348 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c006ba0 con 0x7f74240a4990 2023-09-30T01:56:02.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.932+0000 7f740bfff700 1 -- 172.21.15.55:0/3267917348 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f741c006d00 con 0x7f74240a4990 2023-09-30T01:56:02.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.932+0000 7f74297fe700 1 -- 172.21.15.55:0/3267917348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74180094f0 con 0x7f74240a4990 2023-09-30T01:56:02.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.932+0000 7f740bfff700 1 -- 172.21.15.55:0/3267917348 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f741c012880 con 0x7f74240a4990 2023-09-30T01:56:02.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.932+0000 7f74297fe700 1 -- 172.21.15.55:0/3267917348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f742406db00 con 0x7f74240a4990 2023-09-30T01:56:02.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.932+0000 7f74297fe700 1 -- 172.21.15.55:0/3267917348 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7424064440 con 0x7f74240a4990 2023-09-30T01:56:02.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.932+0000 7f740bfff700 1 -- 172.21.15.55:0/3267917348 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f741c012c70 con 0x7f74240a4990 2023-09-30T01:56:02.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.932+0000 7f740bfff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:02.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.932+0000 7f740bfff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:02.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.932+0000 7f740bfff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:02.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.932+0000 7f740bfff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:02.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.932+0000 7f740bfff700 1 --2- 172.21.15.55:0/3267917348 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f741008e8b0 0x7f7410090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:02.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.936+0000 7f740bfff700 1 -- 172.21.15.55:0/3267917348 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f741c0b44e0 con 0x7f74240a4990 2023-09-30T01:56:02.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.936+0000 7f74237fe700 1 --2- 172.21.15.55:0/3267917348 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f741008e8b0 0x7f7410090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:02.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.936+0000 7f74237fe700 1 --2- 172.21.15.55:0/3267917348 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f741008e8b0 0x7f7410090d60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f74180099b0 tx=0x7f7418017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:02.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:02.944+0000 7f740bfff700 1 -- 172.21.15.55:0/3267917348 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f741c084fa0 con 0x7f74240a4990 2023-09-30T01:56:03.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.100+0000 7f74297fe700 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2023-09-30T01:56:03.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.100+0000 7f74297fe700 1 -- 172.21.15.55:0/3267917348 --> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f742409fdd0 con 0x7f741008e8b0 2023-09-30T01:56:03.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.116+0000 7f740bfff700 1 -- 172.21.15.55:0/3267917348 <== mgr.4103 v2:172.21.15.55:6808/27538 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259670 (secure 0 0 0) 0x7f742409fdd0 con 0x7f741008e8b0 2023-09-30T01:56:03.119 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.116+0000 7f740bfff700 20 mgrc handle_command_reply tid 0 r 0 2023-09-30T01:56:03.123 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:03.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.124+0000 7f74297fe700 10 mgrc shutdown 2023-09-30T01:56:03.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.124+0000 7f74297fe700 1 -- 172.21.15.55:0/3267917348 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f741008e8b0 msgr2=0x7f7410090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.124+0000 7f74297fe700 1 --2- 172.21.15.55:0/3267917348 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f741008e8b0 0x7f7410090d60 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f74180099b0 tx=0x7f7418017000 comp rx=0 tx=0).stop 2023-09-30T01:56:03.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.124+0000 7f74297fe700 1 -- 172.21.15.55:0/3267917348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74240a4990 msgr2=0x7f7424099010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.124+0000 7f74297fe700 1 --2- 172.21.15.55:0/3267917348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74240a4990 0x7f7424099010 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f741c00c8e0 tx=0x7f741c001710 comp rx=0 tx=0).stop 2023-09-30T01:56:03.126 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.124+0000 7f74297fe700 1 -- 172.21.15.55:0/3267917348 shutdown_connections 2023-09-30T01:56:03.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.124+0000 7f74297fe700 1 --2- 172.21.15.55:0/3267917348 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f742413a750 0x7f742406e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.124+0000 7f74297fe700 1 --2- 172.21.15.55:0/3267917348 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f741008e8b0 0x7f7410090d60 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.124+0000 7f74297fe700 1 --2- 172.21.15.55:0/3267917348 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f74240a4d60 0x7f742406e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.124+0000 7f74297fe700 1 --2- 172.21.15.55:0/3267917348 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f74240a4990 0x7f7424099010 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.124+0000 7f74297fe700 1 -- 172.21.15.55:0/3267917348 >> 172.21.15.55:0/3267917348 conn(0x7f74240b23d0 msgr2=0x7f74240b13b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:03.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.124+0000 7f74297fe700 1 -- 172.21.15.55:0/3267917348 shutdown_connections 2023-09-30T01:56:03.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.124+0000 7f74297fe700 1 -- 172.21.15.55:0/3267917348 wait complete. 2023-09-30T01:56:03.128 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-09-30T01:56:03.140 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-09-30T01:56:03.029503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":37344,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":35648,"kb_avail":377450016,"statfs":{"total":386547056640,"available":386508816384,"internally_reserved":0,"allocated":1703936,"data_stored":1343230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":36503552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.298572"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.747734+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744924+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:57.376422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743754+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744024+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:50:39.919553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744388+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743816+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:19.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745095+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:27:45.755265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743652+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:39.893506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745697+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:57:14.660722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744166+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:51:07.989623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745306+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:18:41.601447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744907+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:34.069693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":162,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:55.592362+0000","last_change":"2023-09-30T01:55:50.454189+0000","last_active":"2023-09-30T01:55:55.592362+0000","last_peered":"2023-09-30T01:55:55.592362+0000","last_clean":"2023-09-30T01:55:55.592362+0000","last_became_active":"2023-09-30T01:55:50.451349+0000","last_became_peered":"2023-09-30T01:55:50.451349+0000","last_unstale":"2023-09-30T01:55:55.592362+0000","last_undegraded":"2023-09-30T01:55:55.592362+0000","last_fullsized":"2023-09-30T01:55:55.592362+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:49.223709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:49.223709+0000","last_clean_scrub_stamp":"2023-09-30T01:55:49.223709+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:14:10.620817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606434+0000","last_change":"2023-09-30T01:55:55.596984+0000","last_active":"2023-09-30T01:55:56.606434+0000","last_peered":"2023-09-30T01:55:56.606434+0000","last_clean":"2023-09-30T01:55:56.606434+0000","last_became_active":"2023-09-30T01:55:55.596422+0000","last_became_peered":"2023-09-30T01:55:55.596422+0000","last_unstale":"2023-09-30T01:55:56.606434+0000","last_undegraded":"2023-09-30T01:55:56.606434+0000","last_fullsized":"2023-09-30T01:55:56.606434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:25.143805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744614+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:29.325058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606462+0000","last_change":"2023-09-30T01:55:55.599574+0000","last_active":"2023-09-30T01:55:56.606462+0000","last_peered":"2023-09-30T01:55:56.606462+0000","last_clean":"2023-09-30T01:55:56.606462+0000","last_became_active":"2023-09-30T01:55:55.598970+0000","last_became_peered":"2023-09-30T01:55:55.598970+0000","last_unstale":"2023-09-30T01:55:56.606462+0000","last_undegraded":"2023-09-30T01:55:56.606462+0000","last_fullsized":"2023-09-30T01:55:56.606462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:53.195170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739273+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:39.893506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.094161+0000","last_change":"2023-09-30T01:55:56.090039+0000","last_active":"2023-09-30T01:55:56.094161+0000","last_peered":"2023-09-30T01:55:56.094161+0000","last_clean":"2023-09-30T01:55:56.094161+0000","last_became_active":"2023-09-30T01:55:56.089292+0000","last_became_peered":"2023-09-30T01:55:56.089292+0000","last_unstale":"2023-09-30T01:55:56.094161+0000","last_undegraded":"2023-09-30T01:55:56.094161+0000","last_fullsized":"2023-09-30T01:55:56.094161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:04:26.068674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739194+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:17:29.530403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606462+0000","last_change":"2023-09-30T01:55:55.600117+0000","last_active":"2023-09-30T01:55:56.606462+0000","last_peered":"2023-09-30T01:55:56.606462+0000","last_clean":"2023-09-30T01:55:56.606462+0000","last_became_active":"2023-09-30T01:55:55.599019+0000","last_became_peered":"2023-09-30T01:55:55.599019+0000","last_unstale":"2023-09-30T01:55:56.606462+0000","last_undegraded":"2023-09-30T01:55:56.606462+0000","last_fullsized":"2023-09-30T01:55:56.606462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:18:37.420194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744158+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:56:41.268990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743652+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:23:52.565054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.093743+0000","last_change":"2023-09-30T01:55:56.090103+0000","last_active":"2023-09-30T01:55:56.093743+0000","last_peered":"2023-09-30T01:55:56.093743+0000","last_clean":"2023-09-30T01:55:56.093743+0000","last_became_active":"2023-09-30T01:55:56.089319+0000","last_became_peered":"2023-09-30T01:55:56.089319+0000","last_unstale":"2023-09-30T01:55:56.093743+0000","last_undegraded":"2023-09-30T01:55:56.093743+0000","last_fullsized":"2023-09-30T01:55:56.093743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:29.888440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.738825+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:14:41.570446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606572+0000","last_change":"2023-09-30T01:55:55.597415+0000","last_active":"2023-09-30T01:55:56.606572+0000","last_peered":"2023-09-30T01:55:56.606572+0000","last_clean":"2023-09-30T01:55:56.606572+0000","last_became_active":"2023-09-30T01:55:55.596836+0000","last_became_peered":"2023-09-30T01:55:55.596836+0000","last_unstale":"2023-09-30T01:55:56.606572+0000","last_undegraded":"2023-09-30T01:55:56.606572+0000","last_fullsized":"2023-09-30T01:55:56.606572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:29.888440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.746047+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:03:41.802753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:55.599386+0000","last_change":"2023-09-30T01:55:55.597920+0000","last_active":"2023-09-30T01:55:55.599386+0000","last_peered":"2023-09-30T01:55:55.599386+0000","last_clean":"2023-09-30T01:55:55.599386+0000","last_became_active":"2023-09-30T01:55:55.597433+0000","last_became_peered":"2023-09-30T01:55:55.597433+0000","last_unstale":"2023-09-30T01:55:55.599386+0000","last_undegraded":"2023-09-30T01:55:55.599386+0000","last_fullsized":"2023-09-30T01:55:55.599386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:11:56.914296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739003+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:23:52.565054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606498+0000","last_change":"2023-09-30T01:55:55.599569+0000","last_active":"2023-09-30T01:55:56.606498+0000","last_peered":"2023-09-30T01:55:56.606498+0000","last_clean":"2023-09-30T01:55:56.606498+0000","last_became_active":"2023-09-30T01:55:55.599037+0000","last_became_peered":"2023-09-30T01:55:55.599037+0000","last_unstale":"2023-09-30T01:55:56.606498+0000","last_undegraded":"2023-09-30T01:55:56.606498+0000","last_fullsized":"2023-09-30T01:55:56.606498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:03:37.621500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745191+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:08:09.194250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744121+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:29.325058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745614+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:45:38.723185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739651+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.746863+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:14:41.570446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.741312+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:19.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.747609+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:22.053979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.748200+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.740994+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:51:07.989623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.746549+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:41:38.413142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744737+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:57.376422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.740814+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7760,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364080,"statfs":{"total":96636764160,"available":96628817920,"internally_reserved":0,"allocated":139264,"data_stored":45248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8832,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363008,"statfs":{"total":96636764160,"available":96627720192,"internally_reserved":0,"allocated":712704,"data_stored":626367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8836,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363004,"statfs":{"total":96636764160,"available":96627716096,"internally_reserved":0,"allocated":716800,"data_stored":627178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11916,"kb_used_data":132,"kb_used_omap":0,"kb_used_meta":11776,"kb_avail":94359924,"statfs":{"total":96636764160,"available":96624562176,"internally_reserved":0,"allocated":135168,"data_stored":44437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12058624},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T01:56:03.147 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T01:56:03.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.244+0000 7f73dd5c9700 1 Processor -- start 2023-09-30T01:56:03.249 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.244+0000 7f73dd5c9700 1 -- start start 2023-09-30T01:56:03.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73dd5c9700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73d80a73f0 0x7f73d8132b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73dd5c9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73d81330d0 0x7f73d80a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73dd5c9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73d80a6d00 con 0x7f73d80a8b00 2023-09-30T01:56:03.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73dd5c9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73d80a77c0 con 0x7f73d81330d0 2023-09-30T01:56:03.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73dd5c9700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80a45d0 con 0x7f73d80a73f0 2023-09-30T01:56:03.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73d7fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73d80a73f0 0x7f73d8132b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73cffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f73d81330d0 0x7f73d80a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73d7fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73d80a73f0 0x7f73d8132b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43648/0 (socket says 172.21.15.55:43648) 2023-09-30T01:56:03.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73d7fff700 1 -- 172.21.15.55:0/2669070056 learned_addr learned my addr 172.21.15.55:0/2669070056 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:03.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73d7fff700 1 -- 172.21.15.55:0/2669070056 >> v2:172.21.15.55:3300/0 conn(0x7f73d81330d0 msgr2=0x7f73d80a85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:03.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73d7fff700 1 --2- 172.21.15.55:0/2669070056 >> v2:172.21.15.55:3300/0 conn(0x7f73d81330d0 0x7f73d80a85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73d7fff700 1 -- 172.21.15.55:0/2669070056 >> v1:172.21.15.133:6789/0 conn(0x7f73d80a8b00 legacy=0x7f73d80a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73d7fff700 1 -- 172.21.15.55:0/2669070056 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d80a8f80 con 0x7f73d80a73f0 2023-09-30T01:56:03.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73cffff700 1 --2- 172.21.15.55:0/2669070056 >> v2:172.21.15.55:3300/0 conn(0x7f73d81330d0 0x7f73d80a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:03.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73d7fff700 1 --2- 172.21.15.55:0/2669070056 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73d80a73f0 0x7f73d8132b90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f73c800bc30 tx=0x7f73c800b4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cafb51b347a5c1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:03.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73d77fe700 1 -- 172.21.15.55:0/2669070056 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c8005c10 con 0x7f73d80a73f0 2023-09-30T01:56:03.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73d77fe700 1 -- 172.21.15.55:0/2669070056 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c8005d70 con 0x7f73d80a73f0 2023-09-30T01:56:03.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73d77fe700 1 -- 172.21.15.55:0/2669070056 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c800dbc0 con 0x7f73d80a73f0 2023-09-30T01:56:03.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73dd5c9700 1 -- 172.21.15.55:0/2669070056 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73d80a73f0 msgr2=0x7f73d8132b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73dd5c9700 1 --2- 172.21.15.55:0/2669070056 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73d80a73f0 0x7f73d8132b90 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f73c800bc30 tx=0x7f73c800b4c0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73dd5c9700 1 -- 172.21.15.55:0/2669070056 shutdown_connections 2023-09-30T01:56:03.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73dd5c9700 1 --2- 172.21.15.55:0/2669070056 >> v2:172.21.15.55:3300/0 conn(0x7f73d81330d0 0x7f73d80a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73dd5c9700 1 --2- 172.21.15.55:0/2669070056 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73d80a73f0 0x7f73d8132b90 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73dd5c9700 1 -- 172.21.15.55:0/2669070056 >> 172.21.15.55:0/2669070056 conn(0x7f73d8062e20 msgr2=0x7f73d8063220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:03.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73dd5c9700 1 -- 172.21.15.55:0/2669070056 shutdown_connections 2023-09-30T01:56:03.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.248+0000 7f73dd5c9700 1 -- 172.21.15.55:0/2669070056 wait complete. 2023-09-30T01:56:03.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73dd5c9700 1 Processor -- start 2023-09-30T01:56:03.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73dd5c9700 1 -- start start 2023-09-30T01:56:03.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73dd5c9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73d80a73f0 0x7f73d813fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73dd5c9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d80a8b00 0x7f73d80b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73dd5c9700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73d81330d0 0x7f73d81534b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73dd5c9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80b1020 con 0x7f73d80a8b00 2023-09-30T01:56:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73dd5c9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d80b2190 con 0x7f73d80a73f0 2023-09-30T01:56:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73dd5c9700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d8153fa0 con 0x7f73d81330d0 2023-09-30T01:56:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73cffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d80a8b00 0x7f73d80b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73dcdc8700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73d81330d0 0x7f73d81534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73cffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d80a8b00 0x7f73d80b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39822/0 (socket says 172.21.15.55:39822) 2023-09-30T01:56:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73cffff700 1 -- 172.21.15.55:0/1197719311 learned_addr learned my addr 172.21.15.55:0/1197719311 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73d7fff700 1 --2- 172.21.15.55:0/1197719311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73d80a73f0 0x7f73d813fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73cffff700 1 -- 172.21.15.55:0/1197719311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73d81330d0 msgr2=0x7f73d81534b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73cffff700 1 --2- 172.21.15.55:0/1197719311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73d81330d0 0x7f73d81534b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73cffff700 1 -- 172.21.15.55:0/1197719311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73d80a73f0 msgr2=0x7f73d813fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73cffff700 1 --2- 172.21.15.55:0/1197719311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73d80a73f0 0x7f73d813fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73cffff700 1 -- 172.21.15.55:0/1197719311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c0009420 con 0x7f73d80a8b00 2023-09-30T01:56:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73cffff700 1 --2- 172.21.15.55:0/1197719311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d80a8b00 0x7f73d80b1720 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f73c000ec80 tx=0x7f73c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73d4ff9700 1 -- 172.21.15.55:0/1197719311 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c000c7f0 con 0x7f73d80a8b00 2023-09-30T01:56:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73d4ff9700 1 -- 172.21.15.55:0/1197719311 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73c000c950 con 0x7f73d80a8b00 2023-09-30T01:56:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73dd5c9700 1 -- 172.21.15.55:0/1197719311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c800b720 con 0x7f73d80a8b00 2023-09-30T01:56:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73d4ff9700 1 -- 172.21.15.55:0/1197719311 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73c000ccd0 con 0x7f73d80a8b00 2023-09-30T01:56:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.252+0000 7f73dd5c9700 1 -- 172.21.15.55:0/1197719311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73d8140970 con 0x7f73d80a8b00 2023-09-30T01:56:03.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.256+0000 7f73dd5c9700 1 -- 172.21.15.55:0/1197719311 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73d80b1e80 con 0x7f73d80a8b00 2023-09-30T01:56:03.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.256+0000 7f73d4ff9700 1 -- 172.21.15.55:0/1197719311 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f73c0013470 con 0x7f73d80a8b00 2023-09-30T01:56:03.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.256+0000 7f73d4ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.256+0000 7f73d4ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.256+0000 7f73d4ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.256+0000 7f73d4ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.256+0000 7f73d4ff9700 1 --2- 172.21.15.55:0/1197719311 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f73b808e8b0 0x7f73b8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.260+0000 7f73d7fff700 1 --2- 172.21.15.55:0/1197719311 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f73b808e8b0 0x7f73b8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.260+0000 7f73d4ff9700 1 -- 172.21.15.55:0/1197719311 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f73c00b4940 con 0x7f73d80a8b00 2023-09-30T01:56:03.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.260+0000 7f73d7fff700 1 --2- 172.21.15.55:0/1197719311 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f73b808e8b0 0x7f73b8090d60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f73c800b500 tx=0x7f73c801a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:03.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.264+0000 7f73d4ff9700 1 -- 172.21.15.55:0/1197719311 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f73c0088e90 con 0x7f73d80a8b00 2023-09-30T01:56:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.420+0000 7f73dd5c9700 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2023-09-30T01:56:03.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.420+0000 7f73dd5c9700 1 -- 172.21.15.55:0/1197719311 --> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f73d8064440 con 0x7f73b808e8b0 2023-09-30T01:56:03.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.436+0000 7f73d4ff9700 1 -- 172.21.15.55:0/1197719311 <== mgr.4103 v2:172.21.15.55:6808/27538 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259670 (secure 0 0 0) 0x7f73d8064440 con 0x7f73b808e8b0 2023-09-30T01:56:03.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.436+0000 7f73d4ff9700 20 mgrc handle_command_reply tid 0 r 0 2023-09-30T01:56:03.443 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:03.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.440+0000 7f73dd5c9700 10 mgrc shutdown 2023-09-30T01:56:03.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.440+0000 7f73dd5c9700 1 -- 172.21.15.55:0/1197719311 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f73b808e8b0 msgr2=0x7f73b8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.440+0000 7f73dd5c9700 1 --2- 172.21.15.55:0/1197719311 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f73b808e8b0 0x7f73b8090d60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f73c800b500 tx=0x7f73c801a000 comp rx=0 tx=0).stop 2023-09-30T01:56:03.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.440+0000 7f73dd5c9700 1 -- 172.21.15.55:0/1197719311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d80a8b00 msgr2=0x7f73d80b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.440+0000 7f73dd5c9700 1 --2- 172.21.15.55:0/1197719311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d80a8b00 0x7f73d80b1720 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f73c000ec80 tx=0x7f73c00091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.440+0000 7f73dd5c9700 1 -- 172.21.15.55:0/1197719311 shutdown_connections 2023-09-30T01:56:03.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.440+0000 7f73dd5c9700 1 --2- 172.21.15.55:0/1197719311 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f73b808e8b0 0x7f73b8090d60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.440+0000 7f73dd5c9700 1 --2- 172.21.15.55:0/1197719311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73d81330d0 0x7f73d81534b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.440+0000 7f73dd5c9700 1 --2- 172.21.15.55:0/1197719311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73d80a8b00 0x7f73d80b1720 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.440+0000 7f73dd5c9700 1 --2- 172.21.15.55:0/1197719311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73d80a73f0 0x7f73d813fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.440+0000 7f73dd5c9700 1 -- 172.21.15.55:0/1197719311 >> 172.21.15.55:0/1197719311 conn(0x7f73d8062e20 msgr2=0x7f73d812eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:03.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.440+0000 7f73dd5c9700 1 -- 172.21.15.55:0/1197719311 shutdown_connections 2023-09-30T01:56:03.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.440+0000 7f73dd5c9700 1 -- 172.21.15.55:0/1197719311 wait complete. 2023-09-30T01:56:03.447 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-09-30T01:56:03.458 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-09-30T01:56:03.029503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":37344,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":35648,"kb_avail":377450016,"statfs":{"total":386547056640,"available":386508816384,"internally_reserved":0,"allocated":1703936,"data_stored":1343230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":36503552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.298572"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.747734+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744924+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:57.376422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743754+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744024+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:50:39.919553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744388+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743816+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:19.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745095+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:27:45.755265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743652+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:39.893506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745697+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:57:14.660722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744166+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:51:07.989623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745306+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:18:41.601447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744907+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:34.069693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":162,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:55.592362+0000","last_change":"2023-09-30T01:55:50.454189+0000","last_active":"2023-09-30T01:55:55.592362+0000","last_peered":"2023-09-30T01:55:55.592362+0000","last_clean":"2023-09-30T01:55:55.592362+0000","last_became_active":"2023-09-30T01:55:50.451349+0000","last_became_peered":"2023-09-30T01:55:50.451349+0000","last_unstale":"2023-09-30T01:55:55.592362+0000","last_undegraded":"2023-09-30T01:55:55.592362+0000","last_fullsized":"2023-09-30T01:55:55.592362+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:49.223709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:49.223709+0000","last_clean_scrub_stamp":"2023-09-30T01:55:49.223709+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:14:10.620817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606434+0000","last_change":"2023-09-30T01:55:55.596984+0000","last_active":"2023-09-30T01:55:56.606434+0000","last_peered":"2023-09-30T01:55:56.606434+0000","last_clean":"2023-09-30T01:55:56.606434+0000","last_became_active":"2023-09-30T01:55:55.596422+0000","last_became_peered":"2023-09-30T01:55:55.596422+0000","last_unstale":"2023-09-30T01:55:56.606434+0000","last_undegraded":"2023-09-30T01:55:56.606434+0000","last_fullsized":"2023-09-30T01:55:56.606434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:25.143805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744614+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:29.325058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606462+0000","last_change":"2023-09-30T01:55:55.599574+0000","last_active":"2023-09-30T01:55:56.606462+0000","last_peered":"2023-09-30T01:55:56.606462+0000","last_clean":"2023-09-30T01:55:56.606462+0000","last_became_active":"2023-09-30T01:55:55.598970+0000","last_became_peered":"2023-09-30T01:55:55.598970+0000","last_unstale":"2023-09-30T01:55:56.606462+0000","last_undegraded":"2023-09-30T01:55:56.606462+0000","last_fullsized":"2023-09-30T01:55:56.606462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:53.195170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739273+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:39.893506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.094161+0000","last_change":"2023-09-30T01:55:56.090039+0000","last_active":"2023-09-30T01:55:56.094161+0000","last_peered":"2023-09-30T01:55:56.094161+0000","last_clean":"2023-09-30T01:55:56.094161+0000","last_became_active":"2023-09-30T01:55:56.089292+0000","last_became_peered":"2023-09-30T01:55:56.089292+0000","last_unstale":"2023-09-30T01:55:56.094161+0000","last_undegraded":"2023-09-30T01:55:56.094161+0000","last_fullsized":"2023-09-30T01:55:56.094161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:04:26.068674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739194+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:17:29.530403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606462+0000","last_change":"2023-09-30T01:55:55.600117+0000","last_active":"2023-09-30T01:55:56.606462+0000","last_peered":"2023-09-30T01:55:56.606462+0000","last_clean":"2023-09-30T01:55:56.606462+0000","last_became_active":"2023-09-30T01:55:55.599019+0000","last_became_peered":"2023-09-30T01:55:55.599019+0000","last_unstale":"2023-09-30T01:55:56.606462+0000","last_undegraded":"2023-09-30T01:55:56.606462+0000","last_fullsized":"2023-09-30T01:55:56.606462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:18:37.420194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744158+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:56:41.268990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743652+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:23:52.565054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.093743+0000","last_change":"2023-09-30T01:55:56.090103+0000","last_active":"2023-09-30T01:55:56.093743+0000","last_peered":"2023-09-30T01:55:56.093743+0000","last_clean":"2023-09-30T01:55:56.093743+0000","last_became_active":"2023-09-30T01:55:56.089319+0000","last_became_peered":"2023-09-30T01:55:56.089319+0000","last_unstale":"2023-09-30T01:55:56.093743+0000","last_undegraded":"2023-09-30T01:55:56.093743+0000","last_fullsized":"2023-09-30T01:55:56.093743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:29.888440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.738825+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:14:41.570446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606572+0000","last_change":"2023-09-30T01:55:55.597415+0000","last_active":"2023-09-30T01:55:56.606572+0000","last_peered":"2023-09-30T01:55:56.606572+0000","last_clean":"2023-09-30T01:55:56.606572+0000","last_became_active":"2023-09-30T01:55:55.596836+0000","last_became_peered":"2023-09-30T01:55:55.596836+0000","last_unstale":"2023-09-30T01:55:56.606572+0000","last_undegraded":"2023-09-30T01:55:56.606572+0000","last_fullsized":"2023-09-30T01:55:56.606572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:29.888440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.746047+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:03:41.802753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:55.599386+0000","last_change":"2023-09-30T01:55:55.597920+0000","last_active":"2023-09-30T01:55:55.599386+0000","last_peered":"2023-09-30T01:55:55.599386+0000","last_clean":"2023-09-30T01:55:55.599386+0000","last_became_active":"2023-09-30T01:55:55.597433+0000","last_became_peered":"2023-09-30T01:55:55.597433+0000","last_unstale":"2023-09-30T01:55:55.599386+0000","last_undegraded":"2023-09-30T01:55:55.599386+0000","last_fullsized":"2023-09-30T01:55:55.599386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:11:56.914296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739003+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:23:52.565054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606498+0000","last_change":"2023-09-30T01:55:55.599569+0000","last_active":"2023-09-30T01:55:56.606498+0000","last_peered":"2023-09-30T01:55:56.606498+0000","last_clean":"2023-09-30T01:55:56.606498+0000","last_became_active":"2023-09-30T01:55:55.599037+0000","last_became_peered":"2023-09-30T01:55:55.599037+0000","last_unstale":"2023-09-30T01:55:56.606498+0000","last_undegraded":"2023-09-30T01:55:56.606498+0000","last_fullsized":"2023-09-30T01:55:56.606498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:03:37.621500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745191+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:08:09.194250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744121+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:29.325058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745614+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:45:38.723185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739651+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.746863+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:14:41.570446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.741312+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:19.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.747609+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:22.053979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.748200+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.740994+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:51:07.989623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.746549+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:41:38.413142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744737+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:57.376422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.740814+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7760,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364080,"statfs":{"total":96636764160,"available":96628817920,"internally_reserved":0,"allocated":139264,"data_stored":45248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8832,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363008,"statfs":{"total":96636764160,"available":96627720192,"internally_reserved":0,"allocated":712704,"data_stored":626367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8836,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363004,"statfs":{"total":96636764160,"available":96627716096,"internally_reserved":0,"allocated":716800,"data_stored":627178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11916,"kb_used_data":132,"kb_used_omap":0,"kb_used_meta":11776,"kb_avail":94359924,"statfs":{"total":96636764160,"available":96624562176,"internally_reserved":0,"allocated":135168,"data_stored":44437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12058624},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T01:56:03.464 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T01:56:03.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.572+0000 7f958359e700 1 Processor -- start 2023-09-30T01:56:03.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958359e700 1 -- start start 2023-09-30T01:56:03.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958359e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95840a0d80 0x7f95840a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958359e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958409f480 con 0x7f95840a1150 2023-09-30T01:56:03.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f958409f740 con 0x7f958413e6f0 2023-09-30T01:56:03.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958359e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958406e040 con 0x7f95840a0d80 2023-09-30T01:56:03.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f9581d9b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f95840a1150 0x7f958413dfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53116/0 (socket says 172.21.15.55:53116) 2023-09-30T01:56:03.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f9581d9b700 1 -- 172.21.15.55:0/1560387665 learned_addr learned my addr 172.21.15.55:0/1560387665 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:03.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958259c700 1 --2- 172.21.15.55:0/1560387665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95840a0d80 0x7f95840a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 -- 172.21.15.55:0/1560387665 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2133244308 0 0) 0x7f958409f480 con 0x7f95840a1150 2023-09-30T01:56:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 -- 172.21.15.55:0/1560387665 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9570003570 con 0x7f95840a1150 2023-09-30T01:56:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 -- 172.21.15.55:0/1560387665 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3442311182 0 0) 0x7f9570003570 con 0x7f95840a1150 2023-09-30T01:56:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 -- 172.21.15.55:0/1560387665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95840a0d80 msgr2=0x7f95840a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 --2- 172.21.15.55:0/1560387665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95840a0d80 0x7f95840a4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 -- 172.21.15.55:0/1560387665 >> v1:172.21.15.133:6789/0 conn(0x7f958413e6f0 legacy=0x7f9584148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 -- 172.21.15.55:0/1560387665 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95840a2240 con 0x7f95840a1150 2023-09-30T01:56:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 -- 172.21.15.55:0/1560387665 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 254224620 0 0) 0x7f95740017f0 con 0x7f95840a1150 2023-09-30T01:56:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 -- 172.21.15.55:0/1560387665 >> v1:172.21.15.55:6789/0 conn(0x7f95840a1150 legacy=0x7f958413dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 --2- 172.21.15.55:0/1560387665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9570003a90 0x7f9570003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 --2- 172.21.15.55:0/1560387665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9570004810 0x7f9570004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 --2- 172.21.15.55:0/1560387665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95700051c0 0x7f957000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 -- 172.21.15.55:0/1560387665 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958406e040 con 0x7f95700051c0 2023-09-30T01:56:03.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 -- 172.21.15.55:0/1560387665 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f957000c130 con 0x7f9570003a90 2023-09-30T01:56:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 -- 172.21.15.55:0/1560387665 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f957000c2a0 con 0x7f9570004810 2023-09-30T01:56:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f9581d9b700 1 --2- 172.21.15.55:0/1560387665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9570004810 0x7f9570004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f9582d9d700 1 --2- 172.21.15.55:0/1560387665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95700051c0 0x7f957000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958259c700 1 --2- 172.21.15.55:0/1560387665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95840a0d80 0x7f95840a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f9581d9b700 1 -- 172.21.15.55:0/1560387665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9570003a90 msgr2=0x7f9570003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f9581d9b700 1 --2- 172.21.15.55:0/1560387665 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9570003a90 0x7f9570003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f9581d9b700 1 -- 172.21.15.55:0/1560387665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95700051c0 msgr2=0x7f957000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f9581d9b700 1 --2- 172.21.15.55:0/1560387665 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95700051c0 0x7f957000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f9581d9b700 1 -- 172.21.15.55:0/1560387665 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9570003570 con 0x7f9570004810 2023-09-30T01:56:03.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f9581d9b700 1 --2- 172.21.15.55:0/1560387665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9570004810 0x7f9570004c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f957400a930 tx=0x7f95740021f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=203a1ca48d751968 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:03.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 -- 172.21.15.55:0/1560387665 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95740070d0 con 0x7f9570004810 2023-09-30T01:56:03.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 -- 172.21.15.55:0/1560387665 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9574007270 con 0x7f9570004810 2023-09-30T01:56:03.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.576+0000 7f958159a700 1 -- 172.21.15.55:0/1560387665 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9574007630 con 0x7f9570004810 2023-09-30T01:56:03.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.580+0000 7f958359e700 1 -- 172.21.15.55:0/1560387665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9570004810 msgr2=0x7f9570004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.580+0000 7f958359e700 1 --2- 172.21.15.55:0/1560387665 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9570004810 0x7f9570004c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f957400a930 tx=0x7f95740021f0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.580+0000 7f9582d9d700 1 -- 172.21.15.55:0/1560387665 reap_dead start 2023-09-30T01:56:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.580+0000 7f958359e700 1 -- 172.21.15.55:0/1560387665 shutdown_connections 2023-09-30T01:56:03.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.580+0000 7f958359e700 1 -- 172.21.15.55:0/1560387665 >> 172.21.15.55:0/1560387665 conn(0x7f95840b23d0 msgr2=0x7f95840b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:03.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.580+0000 7f958359e700 1 -- 172.21.15.55:0/1560387665 shutdown_connections 2023-09-30T01:56:03.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.580+0000 7f958359e700 1 -- 172.21.15.55:0/1560387665 wait complete. 2023-09-30T01:56:03.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.580+0000 7f958359e700 1 Processor -- start 2023-09-30T01:56:03.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.580+0000 7f958359e700 1 -- start start 2023-09-30T01:56:03.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f958359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9570004810 0x7f958409c950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f958359e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f958414d9d0 0x7f958413b720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f958359e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f958409dfe0 0x7f958414e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f958359e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958409a470 con 0x7f958414d9d0 2023-09-30T01:56:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f958359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f958409ce90 con 0x7f9570004810 2023-09-30T01:56:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f958359e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f958414de80 con 0x7f958409dfe0 2023-09-30T01:56:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f9582d9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f958409dfe0 0x7f958414e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f9582d9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f958409dfe0 0x7f958414e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43684/0 (socket says 172.21.15.55:43684) 2023-09-30T01:56:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f9581d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f958414d9d0 0x7f958413b720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.595 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f9582d9d700 1 -- 172.21.15.55:0/1251052704 learned_addr learned my addr 172.21.15.55:0/1251052704 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:03.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f958259c700 1 --2- 172.21.15.55:0/1251052704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9570004810 0x7f958409c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f9582d9d700 1 -- 172.21.15.55:0/1251052704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9570004810 msgr2=0x7f958409c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f9582d9d700 1 --2- 172.21.15.55:0/1251052704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9570004810 0x7f958409c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f9582d9d700 1 -- 172.21.15.55:0/1251052704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f958414d9d0 msgr2=0x7f958413b720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f9582d9d700 1 --2- 172.21.15.55:0/1251052704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f958414d9d0 0x7f958413b720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f9582d9d700 1 -- 172.21.15.55:0/1251052704 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f958413bc60 con 0x7f958409dfe0 2023-09-30T01:56:03.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f9582d9d700 1 --2- 172.21.15.55:0/1251052704 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f958409dfe0 0x7f958414e140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f95840a5710 tx=0x7f957c007d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f957a7fc700 1 -- 172.21.15.55:0/1251052704 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c006a30 con 0x7f958409dfe0 2023-09-30T01:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f957a7fc700 1 -- 172.21.15.55:0/1251052704 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f957c006b90 con 0x7f958409dfe0 2023-09-30T01:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f958359e700 1 -- 172.21.15.55:0/1251052704 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f958409a650 con 0x7f958409dfe0 2023-09-30T01:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f957a7fc700 1 -- 172.21.15.55:0/1251052704 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f957c007030 con 0x7f958409dfe0 2023-09-30T01:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f958359e700 1 -- 172.21.15.55:0/1251052704 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f958409e680 con 0x7f958409dfe0 2023-09-30T01:56:03.597 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.584+0000 7f958359e700 1 -- 172.21.15.55:0/1251052704 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9584064440 con 0x7f958409dfe0 2023-09-30T01:56:03.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.588+0000 7f957a7fc700 1 -- 172.21.15.55:0/1251052704 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f957c0073a0 con 0x7f958409dfe0 2023-09-30T01:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.588+0000 7f957a7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.588+0000 7f957a7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.588+0000 7f957a7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:03.599 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.588+0000 7f957a7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:03.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.588+0000 7f957a7fc700 1 --2- 172.21.15.55:0/1251052704 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f956408e8b0 0x7f9564090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.588+0000 7f958259c700 1 --2- 172.21.15.55:0/1251052704 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f956408e8b0 0x7f9564090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.588+0000 7f957a7fc700 1 -- 172.21.15.55:0/1251052704 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f957c0b4020 con 0x7f958409dfe0 2023-09-30T01:56:03.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.588+0000 7f958259c700 1 --2- 172.21.15.55:0/1251052704 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f956408e8b0 0x7f9564090d60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f956c0093f0 tx=0x7f956c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:03.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.596+0000 7f957a7fc700 1 -- 172.21.15.55:0/1251052704 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f957c084a50 con 0x7f958409dfe0 2023-09-30T01:56:03.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.752+0000 7f958359e700 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2023-09-30T01:56:03.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.752+0000 7f958359e700 1 -- 172.21.15.55:0/1251052704 --> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9584141ca0 con 0x7f956408e8b0 2023-09-30T01:56:03.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.768+0000 7f957a7fc700 1 -- 172.21.15.55:0/1251052704 <== mgr.4103 v2:172.21.15.55:6808/27538 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259670 (secure 0 0 0) 0x7f9584141ca0 con 0x7f956408e8b0 2023-09-30T01:56:03.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.768+0000 7f957a7fc700 20 mgrc handle_command_reply tid 0 r 0 2023-09-30T01:56:03.774 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:03.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.772+0000 7f958359e700 10 mgrc shutdown 2023-09-30T01:56:03.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.772+0000 7f958359e700 1 -- 172.21.15.55:0/1251052704 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f956408e8b0 msgr2=0x7f9564090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.772+0000 7f958359e700 1 --2- 172.21.15.55:0/1251052704 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f956408e8b0 0x7f9564090d60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f956c0093f0 tx=0x7f956c0091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.772+0000 7f958359e700 1 -- 172.21.15.55:0/1251052704 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f958409dfe0 msgr2=0x7f958414e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.772+0000 7f958359e700 1 --2- 172.21.15.55:0/1251052704 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f958409dfe0 0x7f958414e140 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f95840a5710 tx=0x7f957c007d30 comp rx=0 tx=0).stop 2023-09-30T01:56:03.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.772+0000 7f958359e700 1 -- 172.21.15.55:0/1251052704 shutdown_connections 2023-09-30T01:56:03.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.772+0000 7f958359e700 1 --2- 172.21.15.55:0/1251052704 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f956408e8b0 0x7f9564090d60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.772+0000 7f958359e700 1 --2- 172.21.15.55:0/1251052704 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f958409dfe0 0x7f958414e140 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.777 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.772+0000 7f958359e700 1 --2- 172.21.15.55:0/1251052704 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f958414d9d0 0x7f958413b720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.772+0000 7f958359e700 1 --2- 172.21.15.55:0/1251052704 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9570004810 0x7f958409c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.772+0000 7f958359e700 1 -- 172.21.15.55:0/1251052704 >> 172.21.15.55:0/1251052704 conn(0x7f95840b23d0 msgr2=0x7f958413d250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:03.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.772+0000 7f958359e700 1 -- 172.21.15.55:0/1251052704 shutdown_connections 2023-09-30T01:56:03.778 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.772+0000 7f958359e700 1 -- 172.21.15.55:0/1251052704 wait complete. 2023-09-30T01:56:03.779 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-09-30T01:56:03.788 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-09-30T01:56:03.029503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":37344,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":35648,"kb_avail":377450016,"statfs":{"total":386547056640,"available":386508816384,"internally_reserved":0,"allocated":1703936,"data_stored":1343230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":36503552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.298572"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.747734+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744924+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:57.376422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743754+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744024+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:50:39.919553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744388+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743816+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:19.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745095+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:27:45.755265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743652+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:39.893506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745697+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:57:14.660722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744166+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:51:07.989623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745306+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:18:41.601447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744907+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:34.069693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":162,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:55.592362+0000","last_change":"2023-09-30T01:55:50.454189+0000","last_active":"2023-09-30T01:55:55.592362+0000","last_peered":"2023-09-30T01:55:55.592362+0000","last_clean":"2023-09-30T01:55:55.592362+0000","last_became_active":"2023-09-30T01:55:50.451349+0000","last_became_peered":"2023-09-30T01:55:50.451349+0000","last_unstale":"2023-09-30T01:55:55.592362+0000","last_undegraded":"2023-09-30T01:55:55.592362+0000","last_fullsized":"2023-09-30T01:55:55.592362+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:49.223709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:49.223709+0000","last_clean_scrub_stamp":"2023-09-30T01:55:49.223709+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:14:10.620817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606434+0000","last_change":"2023-09-30T01:55:55.596984+0000","last_active":"2023-09-30T01:55:56.606434+0000","last_peered":"2023-09-30T01:55:56.606434+0000","last_clean":"2023-09-30T01:55:56.606434+0000","last_became_active":"2023-09-30T01:55:55.596422+0000","last_became_peered":"2023-09-30T01:55:55.596422+0000","last_unstale":"2023-09-30T01:55:56.606434+0000","last_undegraded":"2023-09-30T01:55:56.606434+0000","last_fullsized":"2023-09-30T01:55:56.606434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:25.143805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744614+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:29.325058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606462+0000","last_change":"2023-09-30T01:55:55.599574+0000","last_active":"2023-09-30T01:55:56.606462+0000","last_peered":"2023-09-30T01:55:56.606462+0000","last_clean":"2023-09-30T01:55:56.606462+0000","last_became_active":"2023-09-30T01:55:55.598970+0000","last_became_peered":"2023-09-30T01:55:55.598970+0000","last_unstale":"2023-09-30T01:55:56.606462+0000","last_undegraded":"2023-09-30T01:55:56.606462+0000","last_fullsized":"2023-09-30T01:55:56.606462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:53.195170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739273+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:39.893506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.094161+0000","last_change":"2023-09-30T01:55:56.090039+0000","last_active":"2023-09-30T01:55:56.094161+0000","last_peered":"2023-09-30T01:55:56.094161+0000","last_clean":"2023-09-30T01:55:56.094161+0000","last_became_active":"2023-09-30T01:55:56.089292+0000","last_became_peered":"2023-09-30T01:55:56.089292+0000","last_unstale":"2023-09-30T01:55:56.094161+0000","last_undegraded":"2023-09-30T01:55:56.094161+0000","last_fullsized":"2023-09-30T01:55:56.094161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:04:26.068674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739194+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:17:29.530403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606462+0000","last_change":"2023-09-30T01:55:55.600117+0000","last_active":"2023-09-30T01:55:56.606462+0000","last_peered":"2023-09-30T01:55:56.606462+0000","last_clean":"2023-09-30T01:55:56.606462+0000","last_became_active":"2023-09-30T01:55:55.599019+0000","last_became_peered":"2023-09-30T01:55:55.599019+0000","last_unstale":"2023-09-30T01:55:56.606462+0000","last_undegraded":"2023-09-30T01:55:56.606462+0000","last_fullsized":"2023-09-30T01:55:56.606462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:18:37.420194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744158+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:56:41.268990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743652+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:23:52.565054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.093743+0000","last_change":"2023-09-30T01:55:56.090103+0000","last_active":"2023-09-30T01:55:56.093743+0000","last_peered":"2023-09-30T01:55:56.093743+0000","last_clean":"2023-09-30T01:55:56.093743+0000","last_became_active":"2023-09-30T01:55:56.089319+0000","last_became_peered":"2023-09-30T01:55:56.089319+0000","last_unstale":"2023-09-30T01:55:56.093743+0000","last_undegraded":"2023-09-30T01:55:56.093743+0000","last_fullsized":"2023-09-30T01:55:56.093743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:29.888440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.738825+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:14:41.570446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606572+0000","last_change":"2023-09-30T01:55:55.597415+0000","last_active":"2023-09-30T01:55:56.606572+0000","last_peered":"2023-09-30T01:55:56.606572+0000","last_clean":"2023-09-30T01:55:56.606572+0000","last_became_active":"2023-09-30T01:55:55.596836+0000","last_became_peered":"2023-09-30T01:55:55.596836+0000","last_unstale":"2023-09-30T01:55:56.606572+0000","last_undegraded":"2023-09-30T01:55:56.606572+0000","last_fullsized":"2023-09-30T01:55:56.606572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:29.888440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.746047+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:03:41.802753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:55.599386+0000","last_change":"2023-09-30T01:55:55.597920+0000","last_active":"2023-09-30T01:55:55.599386+0000","last_peered":"2023-09-30T01:55:55.599386+0000","last_clean":"2023-09-30T01:55:55.599386+0000","last_became_active":"2023-09-30T01:55:55.597433+0000","last_became_peered":"2023-09-30T01:55:55.597433+0000","last_unstale":"2023-09-30T01:55:55.599386+0000","last_undegraded":"2023-09-30T01:55:55.599386+0000","last_fullsized":"2023-09-30T01:55:55.599386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:11:56.914296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739003+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:23:52.565054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606498+0000","last_change":"2023-09-30T01:55:55.599569+0000","last_active":"2023-09-30T01:55:56.606498+0000","last_peered":"2023-09-30T01:55:56.606498+0000","last_clean":"2023-09-30T01:55:56.606498+0000","last_became_active":"2023-09-30T01:55:55.599037+0000","last_became_peered":"2023-09-30T01:55:55.599037+0000","last_unstale":"2023-09-30T01:55:56.606498+0000","last_undegraded":"2023-09-30T01:55:56.606498+0000","last_fullsized":"2023-09-30T01:55:56.606498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:03:37.621500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745191+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:08:09.194250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744121+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:29.325058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745614+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:45:38.723185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739651+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.746863+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:14:41.570446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.741312+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:19.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.747609+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:22.053979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.748200+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.740994+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:51:07.989623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.746549+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:41:38.413142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744737+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:57.376422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.740814+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7760,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364080,"statfs":{"total":96636764160,"available":96628817920,"internally_reserved":0,"allocated":139264,"data_stored":45248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8832,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363008,"statfs":{"total":96636764160,"available":96627720192,"internally_reserved":0,"allocated":712704,"data_stored":626367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8836,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363004,"statfs":{"total":96636764160,"available":96627716096,"internally_reserved":0,"allocated":716800,"data_stored":627178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11916,"kb_used_data":132,"kb_used_omap":0,"kb_used_meta":11776,"kb_avail":94359924,"statfs":{"total":96636764160,"available":96624562176,"internally_reserved":0,"allocated":135168,"data_stored":44437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12058624},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T01:56:03.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3f is not active+clean 2023-09-30T01:56:03.796 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.796 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3e is not active+clean 2023-09-30T01:56:03.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3d is not active+clean 2023-09-30T01:56:03.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3c is not active+clean 2023-09-30T01:56:03.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3b is not active+clean 2023-09-30T01:56:03.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.797 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3a is not active+clean 2023-09-30T01:56:03.797 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.39 is not active+clean 2023-09-30T01:56:03.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.38 is not active+clean 2023-09-30T01:56:03.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.37 is not active+clean 2023-09-30T01:56:03.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.798 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.36 is not active+clean 2023-09-30T01:56:03.798 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.35 is not active+clean 2023-09-30T01:56:03.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.34 is not active+clean 2023-09-30T01:56:03.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.33 is not active+clean 2023-09-30T01:56:03.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.32 is not active+clean 2023-09-30T01:56:03.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.799 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.31 is not active+clean 2023-09-30T01:56:03.799 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.30 is not active+clean 2023-09-30T01:56:03.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2f is not active+clean 2023-09-30T01:56:03.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2e is not active+clean 2023-09-30T01:56:03.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2d is not active+clean 2023-09-30T01:56:03.800 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.800 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2c is not active+clean 2023-09-30T01:56:03.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2b is not active+clean 2023-09-30T01:56:03.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2a is not active+clean 2023-09-30T01:56:03.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.29 is not active+clean 2023-09-30T01:56:03.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.28 is not active+clean 2023-09-30T01:56:03.801 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.801 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.27 is not active+clean 2023-09-30T01:56:03.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.26 is not active+clean 2023-09-30T01:56:03.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.25 is not active+clean 2023-09-30T01:56:03.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.24 is not active+clean 2023-09-30T01:56:03.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.802 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.23 is not active+clean 2023-09-30T01:56:03.802 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.22 is not active+clean 2023-09-30T01:56:03.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.21 is not active+clean 2023-09-30T01:56:03.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.20 is not active+clean 2023-09-30T01:56:03.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-09-30T01:56:03.803 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.803 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-09-30T01:56:03.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.747734+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T01:56:03.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-09-30T01:56:03.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-09-30T01:56:03.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.744924+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T03:41:57.376422+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-30T01:56:03.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-09-30T01:56:03.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.804 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-09-30T01:56:03.804 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.743754+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T01:56:03.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-09-30T01:56:03.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-09-30T01:56:03.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.744024+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T10:50:39.919553+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T01:56:03.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-09-30T01:56:03.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.744388+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T01:56:03.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-09-30T01:56:03.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.805 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-09-30T01:56:03.805 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.743816+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T09:45:19.318729+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T01:56:03.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-09-30T01:56:03.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-09-30T01:56:03.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.745095+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:27:45.755265+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T01:56:03.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-09-30T01:56:03.806 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.806 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-09-30T01:56:03.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.743652+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T05:37:39.893506+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T01:56:03.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-09-30T01:56:03.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-09-30T01:56:03.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.745697+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T05:57:14.660722+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T01:56:03.807 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-09-30T01:56:03.807 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-09-30T01:56:03.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.744166+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:51:07.989623+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T01:56:03.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-09-30T01:56:03.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-09-30T01:56:03.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.745306+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:18:41.601447+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T01:56:03.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-09-30T01:56:03.808 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.808 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-09-30T01:56:03.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.744907+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:04:34.069693+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T01:56:03.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-09-30T01:56:03.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-09-30T01:56:03.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.744614+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T04:37:29.325058+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T01:56:03.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-09-30T01:56:03.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-09-30T01:56:03.809 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.739273+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T05:37:39.893506+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-30T01:56:03.809 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-09-30T01:56:03.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-09-30T01:56:03.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.739194+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:17:29.530403+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-30T01:56:03.810 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-09-30T01:56:03.810 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-09-30T01:56:03.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.744158+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T05:56:41.268990+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T01:56:03.811 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-09-30T01:56:03.811 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.812 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-09-30T01:56:03.812 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.743652+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T04:23:52.565054+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T01:56:03.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-09-30T01:56:03.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-09-30T01:56:03.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.738825+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T10:14:41.570446+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-30T01:56:03.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-09-30T01:56:03.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-09-30T01:56:03.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.746047+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T03:03:41.802753+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T01:56:03.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-09-30T01:56:03.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-09-30T01:56:03.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.739003+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T04:23:52.565054+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-30T01:56:03.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-09-30T01:56:03.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-09-30T01:56:03.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-09-30T01:56:03.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.745191+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T04:08:09.194250+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T01:56:03.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-09-30T01:56:03.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-09-30T01:56:03.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.744121+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T04:37:29.325058+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-09-30T01:56:03.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-09-30T01:56:03.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.745614+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T06:45:38.723185+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T01:56:03.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-09-30T01:56:03.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-09-30T01:56:03.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.739651+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-30T01:56:03.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-09-30T01:56:03.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-09-30T01:56:03.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-09-30T01:56:03.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.746863+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T10:14:41.570446+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T01:56:03.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-09-30T01:56:03.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-09-30T01:56:03.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.741312+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T09:45:19.318729+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-30T01:56:03.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-09-30T01:56:03.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-09-30T01:56:03.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.747609+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T02:34:22.053979+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T01:56:03.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-09-30T01:56:03.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-09-30T01:56:03.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.748200+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T01:56:03.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-09-30T01:56:03.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-09-30T01:56:03.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.740994+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T07:51:07.989623+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-30T01:56:03.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-09-30T01:56:03.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-09-30T01:56:03.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.746549+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T06:41:38.413142+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-09-30T01:56:03.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-09-30T01:56:03.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-09-30T01:56:03.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.744737+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T03:41:57.376422+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-09-30T01:56:03.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-09-30T01:56:03.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-09-30T01:55:59.730651+0000', 'last_change': '2023-09-30T01:55:59.730651+0000', 'last_active': '2023-09-30T01:55:59.730651+0000', 'last_peered': '2023-09-30T01:55:59.730651+0000', 'last_clean': '2023-09-30T01:55:59.730651+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:59.730651+0000', 'last_undegraded': '2023-09-30T01:55:59.730651+0000', 'last_fullsized': '2023-09-30T01:55:59.730651+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:59.730651+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-09-30T01:56:03.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-09-30T01:56:03.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-09-30T01:55:58.717648+0000', 'last_change': '2023-09-30T01:55:58.740814+0000', 'last_active': '2023-09-30T01:55:58.717648+0000', 'last_peered': '2023-09-30T01:55:58.717648+0000', 'last_clean': '2023-09-30T01:55:58.717648+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-09-30T01:55:58.717648+0000', 'last_undegraded': '2023-09-30T01:55:58.717648+0000', 'last_fullsized': '2023-09-30T01:55:58.717648+0000', 'mapping_epoch': 16, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 16, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'last_clean_scrub_stamp': '2023-09-30T01:55:58.717648+0000', 'objects_scrubbed': 0, 'log_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-09-30T01:56:03.820 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-09-30T01:56:03.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc3fff700 1 Processor -- start 2023-09-30T01:56:03.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc3fff700 1 -- start start 2023-09-30T01:56:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc3fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3dc40a5f40 0x7f3dc40a6340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3dc4146940 0x7f3dc4148d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc3fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dc413de80 con 0x7f3dc40679e0 2023-09-30T01:56:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc3fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dc40a6880 con 0x7f3dc4146940 2023-09-30T01:56:03.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc3fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc4067db0 con 0x7f3dc40a5f40 2023-09-30T01:56:03.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc27fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3dc40a5f40 0x7f3dc40a6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc37fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3dc4146940 0x7f3dc4148d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc27fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3dc40a5f40 0x7f3dc40a6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43700/0 (socket says 172.21.15.55:43700) 2023-09-30T01:56:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc2ffd700 1 --1- 172.21.15.55:0/593897846 >> v1:172.21.15.133:6789/0 conn(0x7f3dc40679e0 0x7f3dc413d770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.133:6789/0 says I am v1:172.21.15.55:56096/0 (socket says 172.21.15.55:56096) 2023-09-30T01:56:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc27fc700 1 -- 172.21.15.55:0/593897846 learned_addr learned my addr 172.21.15.55:0/593897846 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc37fe700 1 -- 172.21.15.55:0/593897846 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3dc40a5f40 msgr2=0x7f3dc40a6340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc37fe700 1 --2- 172.21.15.55:0/593897846 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3dc40a5f40 0x7f3dc40a6340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc37fe700 1 -- 172.21.15.55:0/593897846 >> v1:172.21.15.133:6789/0 conn(0x7f3dc40679e0 legacy=0x7f3dc413d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc37fe700 1 -- 172.21.15.55:0/593897846 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc40a6e80 con 0x7f3dc4146940 2023-09-30T01:56:03.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc37fe700 1 --2- 172.21.15.55:0/593897846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc4146940 0x7f3dc4148d20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3db40098e0 tx=0x7f3db40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=161f6a82f8962b36 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc1ffb700 1 -- 172.21.15.55:0/593897846 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db400b640 con 0x7f3dc4146940 2023-09-30T01:56:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc1ffb700 1 -- 172.21.15.55:0/593897846 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db400b7a0 con 0x7f3dc4146940 2023-09-30T01:56:03.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.928+0000 7f3dc1ffb700 1 -- 172.21.15.55:0/593897846 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db400bb40 con 0x7f3dc4146940 2023-09-30T01:56:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 -- 172.21.15.55:0/593897846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc4146940 msgr2=0x7f3dc4148d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 --2- 172.21.15.55:0/593897846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc4146940 0x7f3dc4148d20 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3db40098e0 tx=0x7f3db40091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 -- 172.21.15.55:0/593897846 shutdown_connections 2023-09-30T01:56:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 --2- 172.21.15.55:0/593897846 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc4146940 0x7f3dc4148d20 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 --2- 172.21.15.55:0/593897846 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3dc40a5f40 0x7f3dc40a6340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 -- 172.21.15.55:0/593897846 >> 172.21.15.55:0/593897846 conn(0x7f3dc406ff20 msgr2=0x7f3dc40670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 -- 172.21.15.55:0/593897846 shutdown_connections 2023-09-30T01:56:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 -- 172.21.15.55:0/593897846 wait complete. 2023-09-30T01:56:03.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 Processor -- start 2023-09-30T01:56:03.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 -- start start 2023-09-30T01:56:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc40679e0 0x7f3dc4142920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc40a5f40 0x7f3dc413aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3dc4146940 0x7f3dc406a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc4144f00 con 0x7f3dc40a5f40 2023-09-30T01:56:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc4143340 con 0x7f3dc40679e0 2023-09-30T01:56:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dc4143600 con 0x7f3dc4146940 2023-09-30T01:56:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3dc4146940 0x7f3dc406a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3dc4146940 0x7f3dc406a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43716/0 (socket says 172.21.15.55:43716) 2023-09-30T01:56:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc37fe700 1 -- 172.21.15.55:0/1501717532 learned_addr learned my addr 172.21.15.55:0/1501717532 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc27fc700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc40a5f40 0x7f3dc413aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc2ffd700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc40679e0 0x7f3dc4142920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc37fe700 1 -- 172.21.15.55:0/1501717532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc40679e0 msgr2=0x7f3dc4142920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc37fe700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc40679e0 0x7f3dc4142920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc37fe700 1 -- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc40a5f40 msgr2=0x7f3dc413aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc37fe700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc40a5f40 0x7f3dc413aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc37fe700 1 -- 172.21.15.55:0/1501717532 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db4009420 con 0x7f3dc4146940 2023-09-30T01:56:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc27fc700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc40a5f40 0x7f3dc413aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:56:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc37fe700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3dc4146940 0x7f3dc406a610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3db4013000 tx=0x7f3db4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3daaffd700 1 -- 172.21.15.55:0/1501717532 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db401be40 con 0x7f3dc4146940 2023-09-30T01:56:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3daaffd700 1 -- 172.21.15.55:0/1501717532 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db4011630 con 0x7f3dc4146940 2023-09-30T01:56:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 -- 172.21.15.55:0/1501717532 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dc413af40 con 0x7f3dc4146940 2023-09-30T01:56:03.939 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3daaffd700 1 -- 172.21.15.55:0/1501717532 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db40119f0 con 0x7f3dc4146940 2023-09-30T01:56:03.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.932+0000 7f3dc3fff700 1 -- 172.21.15.55:0/1501717532 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dc413b830 con 0x7f3dc4146940 2023-09-30T01:56:03.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.936+0000 7f3dc3fff700 1 -- 172.21.15.55:0/1501717532 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dc4064440 con 0x7f3dc4146940 2023-09-30T01:56:03.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.936+0000 7f3daaffd700 1 -- 172.21.15.55:0/1501717532 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f3db402e440 con 0x7f3dc4146940 2023-09-30T01:56:03.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.936+0000 7f3daaffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:03.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.936+0000 7f3daaffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:03.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.936+0000 7f3daaffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:03.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.936+0000 7f3daaffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:03.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.936+0000 7f3daaffd700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f3db008e8b0 0x7f3db0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:03.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.936+0000 7f3dc2ffd700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f3db008e8b0 0x7f3db0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:03.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.936+0000 7f3daaffd700 1 -- 172.21.15.55:0/1501717532 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f3db40b63c0 con 0x7f3dc4146940 2023-09-30T01:56:03.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.940+0000 7f3dc2ffd700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f3db008e8b0 0x7f3db0090d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc001f80 tx=0x7f3dbc005cd0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:03.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:03.944+0000 7f3daaffd700 1 -- 172.21.15.55:0/1501717532 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3db4086e80 con 0x7f3dc4146940 2023-09-30T01:56:04.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3dc3fff700 1 -- 172.21.15.55:0/1501717532 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f3dc40b1b70 con 0x7f3dc4146940 2023-09-30T01:56:04.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3daaffd700 1 -- 172.21.15.55:0/1501717532 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1289 (secure 0 0 0) 0x7f3db408a4a0 con 0x7f3dc4146940 2023-09-30T01:56:04.174 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:04.174 INFO:teuthology.orchestra.run.smithi055.stdout:{"fsid":"37496c89-c485-46e5-8550-5722d2abf46a","health":{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":25,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":19,"num_osds":4,"num_up_osds":4,"osd_up_since":1696038948,"num_in_osds":4,"osd_in_since":1696038939,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":9}],"num_pgs":105,"num_pools":4,"num_objects":2,"data_bytes":590368,"bytes_used":38240256,"bytes_avail":386508816384,"bytes_total":386547056640,"unknown_pgs_ratio":0.60952383279800415,"inactive_pgs_ratio":0.30476191639900208},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4258}],"up:standby":2},"mgrmap":{"available":true,"num_standbys":2,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-09-30T01:55:38.701004+0000","services":{}},"progress_events":{}} 2023-09-30T01:56:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3dc3fff700 10 mgrc shutdown 2023-09-30T01:56:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3dc3fff700 1 -- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f3db008e8b0 msgr2=0x7f3db0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3dc3fff700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f3db008e8b0 0x7f3db0090d60 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc001f80 tx=0x7f3dbc005cd0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3dc3fff700 1 -- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3dc4146940 msgr2=0x7f3dc406a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3dc3fff700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3dc4146940 0x7f3dc406a610 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3db4013000 tx=0x7f3db4017000 comp rx=0 tx=0).stop 2023-09-30T01:56:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3dc3fff700 1 -- 172.21.15.55:0/1501717532 shutdown_connections 2023-09-30T01:56:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3dc3fff700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f3db008e8b0 0x7f3db0090d60 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3dc3fff700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3dc4146940 0x7f3dc406a610 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3dc3fff700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3dc40a5f40 0x7f3dc413aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3dc3fff700 1 --2- 172.21.15.55:0/1501717532 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3dc40679e0 0x7f3dc4142920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3dc3fff700 1 -- 172.21.15.55:0/1501717532 >> 172.21.15.55:0/1501717532 conn(0x7f3dc406ff20 msgr2=0x7f3dc40a7610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:04.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3dc3fff700 1 -- 172.21.15.55:0/1501717532 shutdown_connections 2023-09-30T01:56:04.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.172+0000 7f3dc3fff700 1 -- 172.21.15.55:0/1501717532 wait complete. 2023-09-30T01:56:04.189 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-09-30T01:56:04.189 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T01:56:04.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc258d700 1 Processor -- start 2023-09-30T01:56:04.299 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc258d700 1 -- start start 2023-09-30T01:56:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc258d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdbbc0670a0 0x7fdbbc140150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc258d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdbbc067470 0x7fdbbc13f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc258d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbbc13fca0 con 0x7fdbbc0a7070 2023-09-30T01:56:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc258d700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc070630 con 0x7fdbbc067470 2023-09-30T01:56:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc258d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbbc06cdc0 con 0x7fdbbc0670a0 2023-09-30T01:56:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc0d8a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdbbc067470 0x7fdbbc13f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc0d8a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdbbc067470 0x7fdbbc13f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39870/0 (socket says 172.21.15.55:39870) 2023-09-30T01:56:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc0d8a700 1 -- 172.21.15.55:0/3640470772 learned_addr learned my addr 172.21.15.55:0/3640470772 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc0d8a700 1 -- 172.21.15.55:0/3640470772 >> v2:172.21.15.133:3300/0 conn(0x7fdbbc0670a0 msgr2=0x7fdbbc140150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:04.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc158b700 1 --2- 172.21.15.55:0/3640470772 >> v2:172.21.15.133:3300/0 conn(0x7fdbbc0670a0 0x7fdbbc140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc0d8a700 1 --2- 172.21.15.55:0/3640470772 >> v2:172.21.15.133:3300/0 conn(0x7fdbbc0670a0 0x7fdbbc140150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc0d8a700 1 -- 172.21.15.55:0/3640470772 >> v1:172.21.15.133:6789/0 conn(0x7fdbbc0a7070 legacy=0x7fdbbc06ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc0d8a700 1 -- 172.21.15.55:0/3640470772 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbbc06d080 con 0x7fdbbc067470 2023-09-30T01:56:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc158b700 1 --2- 172.21.15.55:0/3640470772 >> v2:172.21.15.133:3300/0 conn(0x7fdbbc0670a0 0x7fdbbc140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T01:56:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbc0d8a700 1 --2- 172.21.15.55:0/3640470772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbbc067470 0x7fdbbc13f760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc067a70 tx=0x7fdbb800b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7cd38b8a55ce0cc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbb3fff700 1 -- 172.21.15.55:0/3640470772 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb800dc10 con 0x7fdbbc067470 2023-09-30T01:56:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbb3fff700 1 -- 172.21.15.55:0/3640470772 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb800dd70 con 0x7fdbbc067470 2023-09-30T01:56:04.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.296+0000 7fdbb3fff700 1 -- 172.21.15.55:0/3640470772 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb80106c0 con 0x7fdbbc067470 2023-09-30T01:56:04.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 -- 172.21.15.55:0/3640470772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbbc067470 msgr2=0x7fdbbc13f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:04.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 --2- 172.21.15.55:0/3640470772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbbc067470 0x7fdbbc13f760 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc067a70 tx=0x7fdbb800b4f0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 -- 172.21.15.55:0/3640470772 shutdown_connections 2023-09-30T01:56:04.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 --2- 172.21.15.55:0/3640470772 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbbc067470 0x7fdbbc13f760 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 --2- 172.21.15.55:0/3640470772 >> v2:172.21.15.133:3300/0 conn(0x7fdbbc0670a0 0x7fdbbc140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 -- 172.21.15.55:0/3640470772 >> 172.21.15.55:0/3640470772 conn(0x7fdbbc06a7b0 msgr2=0x7fdbbc0a53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 -- 172.21.15.55:0/3640470772 shutdown_connections 2023-09-30T01:56:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 -- 172.21.15.55:0/3640470772 wait complete. 2023-09-30T01:56:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 Processor -- start 2023-09-30T01:56:04.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 -- start start 2023-09-30T01:56:04.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdbbc0670a0 0x7fdbbc12ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:04.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc067470 0x7fdbbc130e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:04.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbbc0a7070 0x7fdbbc0a1d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:04.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc12e500 con 0x7fdbbc0a7070 2023-09-30T01:56:04.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc12c270 con 0x7fdbbc067470 2023-09-30T01:56:04.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc258d700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbbc12f430 con 0x7fdbbc0670a0 2023-09-30T01:56:04.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc1d8c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbbc0a7070 0x7fdbbc0a1d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:04.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc1d8c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbbc0a7070 0x7fdbbc0a1d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39872/0 (socket says 172.21.15.55:39872) 2023-09-30T01:56:04.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc158b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdbbc0670a0 0x7fdbbc12ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:04.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc1d8c700 1 -- 172.21.15.55:0/2758617810 learned_addr learned my addr 172.21.15.55:0/2758617810 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:04.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc0d8a700 1 --2- 172.21.15.55:0/2758617810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc067470 0x7fdbbc130e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:04.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc1d8c700 1 -- 172.21.15.55:0/2758617810 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdbbc0670a0 msgr2=0x7fdbbc12ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:04.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc1d8c700 1 --2- 172.21.15.55:0/2758617810 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdbbc0670a0 0x7fdbbc12ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.300+0000 7fdbc1d8c700 1 -- 172.21.15.55:0/2758617810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc067470 msgr2=0x7fdbbc130e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:04.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.304+0000 7fdbc1d8c700 1 --2- 172.21.15.55:0/2758617810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc067470 0x7fdbbc130e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.304+0000 7fdbc1d8c700 1 -- 172.21.15.55:0/2758617810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb800b790 con 0x7fdbbc0a7070 2023-09-30T01:56:04.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.304+0000 7fdbc1d8c700 1 --2- 172.21.15.55:0/2758617810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbbc0a7070 0x7fdbbc0a1d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400c960 tx=0x7fdbb40026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:04.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.304+0000 7fdbb17fa700 1 -- 172.21.15.55:0/2758617810 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4012630 con 0x7fdbbc0a7070 2023-09-30T01:56:04.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.304+0000 7fdbb17fa700 1 -- 172.21.15.55:0/2758617810 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbb4012790 con 0x7fdbbc0a7070 2023-09-30T01:56:04.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.304+0000 7fdbc258d700 1 -- 172.21.15.55:0/2758617810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbbc12b0e0 con 0x7fdbbc0a7070 2023-09-30T01:56:04.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.304+0000 7fdbb17fa700 1 -- 172.21.15.55:0/2758617810 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4012b50 con 0x7fdbbc0a7070 2023-09-30T01:56:04.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.304+0000 7fdbc258d700 1 -- 172.21.15.55:0/2758617810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbbc13d250 con 0x7fdbbc0a7070 2023-09-30T01:56:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.304+0000 7fdbc258d700 1 -- 172.21.15.55:0/2758617810 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbbc06fe40 con 0x7fdbbc0a7070 2023-09-30T01:56:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.308+0000 7fdbb17fa700 1 -- 172.21.15.55:0/2758617810 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fdbb401b400 con 0x7fdbbc0a7070 2023-09-30T01:56:04.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.308+0000 7fdbb17fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.308+0000 7fdbb17fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.308+0000 7fdbb17fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.308+0000 7fdbb17fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.308+0000 7fdbb17fa700 1 --2- 172.21.15.55:0/2758617810 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdba008e8b0 0x7fdba0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.308+0000 7fdbc158b700 1 --2- 172.21.15.55:0/2758617810 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdba008e8b0 0x7fdba0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:04.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.308+0000 7fdbb17fa700 1 -- 172.21.15.55:0/2758617810 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fdbb40b4b40 con 0x7fdbbc0a7070 2023-09-30T01:56:04.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.308+0000 7fdbc158b700 1 --2- 172.21.15.55:0/2758617810 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdba008e8b0 0x7fdba0090d60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdbac006fd0 tx=0x7fdbac008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:04.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.316+0000 7fdbb17fa700 1 -- 172.21.15.55:0/2758617810 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdbbc06fe40 con 0x7fdbbc0a7070 2023-09-30T01:56:04.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.472+0000 7fdbc258d700 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2023-09-30T01:56:04.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.472+0000 7fdbc258d700 1 -- 172.21.15.55:0/2758617810 --> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdbbc12a430 con 0x7fdba008e8b0 2023-09-30T01:56:04.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.480+0000 7fdbb17fa700 1 -- 172.21.15.55:0/2758617810 <== mgr.4103 v2:172.21.15.55:6808/27538 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+259670 (secure 0 0 0) 0x7fdbbc12a430 con 0x7fdba008e8b0 2023-09-30T01:56:04.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.480+0000 7fdbb17fa700 20 mgrc handle_command_reply tid 0 r 0 2023-09-30T01:56:04.485 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.484+0000 7fdbc258d700 10 mgrc shutdown 2023-09-30T01:56:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.484+0000 7fdbc258d700 1 -- 172.21.15.55:0/2758617810 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdba008e8b0 msgr2=0x7fdba0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.484+0000 7fdbc258d700 1 --2- 172.21.15.55:0/2758617810 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdba008e8b0 0x7fdba0090d60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fdbac006fd0 tx=0x7fdbac008040 comp rx=0 tx=0).stop 2023-09-30T01:56:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.484+0000 7fdbc258d700 1 -- 172.21.15.55:0/2758617810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbbc0a7070 msgr2=0x7fdbbc0a1d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.484+0000 7fdbc258d700 1 --2- 172.21.15.55:0/2758617810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbbc0a7070 0x7fdbbc0a1d40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400c960 tx=0x7fdbb40026e0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.484+0000 7fdbc258d700 1 -- 172.21.15.55:0/2758617810 shutdown_connections 2023-09-30T01:56:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.484+0000 7fdbc258d700 1 --2- 172.21.15.55:0/2758617810 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdbbc0a7070 0x7fdbbc0a1d40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.484+0000 7fdbc258d700 1 --2- 172.21.15.55:0/2758617810 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdbbc067470 0x7fdbbc130e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.484+0000 7fdbc258d700 1 --2- 172.21.15.55:0/2758617810 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdba008e8b0 0x7fdba0090d60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.484+0000 7fdbc258d700 1 --2- 172.21.15.55:0/2758617810 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdbbc0670a0 0x7fdbbc12ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:04.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.484+0000 7fdbc258d700 1 -- 172.21.15.55:0/2758617810 >> 172.21.15.55:0/2758617810 conn(0x7fdbbc06a7b0 msgr2=0x7fdbbc06db40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.484+0000 7fdbc258d700 1 -- 172.21.15.55:0/2758617810 shutdown_connections 2023-09-30T01:56:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:04.484+0000 7fdbc258d700 1 -- 172.21.15.55:0/2758617810 wait complete. 2023-09-30T01:56:04.488 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-09-30T01:56:04.502 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-09-30T01:56:03.029503+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":82,"acting":82,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":37344,"kb_used_data":1664,"kb_used_omap":0,"kb_used_meta":35648,"kb_avail":377450016,"statfs":{"total":386547056640,"available":386508816384,"internally_reserved":0,"allocated":1703936,"data_stored":1343230,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":36503552},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.298572"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.747734+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744924+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:57.376422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743754+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744024+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:50:39.919553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744388+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743816+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:19.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745095+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:27:45.755265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743652+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:39.893506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745697+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:57:14.660722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744166+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:51:07.989623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745306+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:18:41.601447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744907+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:34.069693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":162,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:55.592362+0000","last_change":"2023-09-30T01:55:50.454189+0000","last_active":"2023-09-30T01:55:55.592362+0000","last_peered":"2023-09-30T01:55:55.592362+0000","last_clean":"2023-09-30T01:55:55.592362+0000","last_became_active":"2023-09-30T01:55:50.451349+0000","last_became_peered":"2023-09-30T01:55:50.451349+0000","last_unstale":"2023-09-30T01:55:55.592362+0000","last_undegraded":"2023-09-30T01:55:55.592362+0000","last_fullsized":"2023-09-30T01:55:55.592362+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:49.223709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:49.223709+0000","last_clean_scrub_stamp":"2023-09-30T01:55:49.223709+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:14:10.620817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606434+0000","last_change":"2023-09-30T01:55:55.596984+0000","last_active":"2023-09-30T01:55:56.606434+0000","last_peered":"2023-09-30T01:55:56.606434+0000","last_clean":"2023-09-30T01:55:56.606434+0000","last_became_active":"2023-09-30T01:55:55.596422+0000","last_became_peered":"2023-09-30T01:55:55.596422+0000","last_unstale":"2023-09-30T01:55:56.606434+0000","last_undegraded":"2023-09-30T01:55:56.606434+0000","last_fullsized":"2023-09-30T01:55:56.606434+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:25.143805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744614+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:29.325058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606462+0000","last_change":"2023-09-30T01:55:55.599574+0000","last_active":"2023-09-30T01:55:56.606462+0000","last_peered":"2023-09-30T01:55:56.606462+0000","last_clean":"2023-09-30T01:55:56.606462+0000","last_became_active":"2023-09-30T01:55:55.598970+0000","last_became_peered":"2023-09-30T01:55:55.598970+0000","last_unstale":"2023-09-30T01:55:56.606462+0000","last_undegraded":"2023-09-30T01:55:56.606462+0000","last_fullsized":"2023-09-30T01:55:56.606462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:53.195170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739273+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:39.893506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.094161+0000","last_change":"2023-09-30T01:55:56.090039+0000","last_active":"2023-09-30T01:55:56.094161+0000","last_peered":"2023-09-30T01:55:56.094161+0000","last_clean":"2023-09-30T01:55:56.094161+0000","last_became_active":"2023-09-30T01:55:56.089292+0000","last_became_peered":"2023-09-30T01:55:56.089292+0000","last_unstale":"2023-09-30T01:55:56.094161+0000","last_undegraded":"2023-09-30T01:55:56.094161+0000","last_fullsized":"2023-09-30T01:55:56.094161+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:04:26.068674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739194+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:17:29.530403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606462+0000","last_change":"2023-09-30T01:55:55.600117+0000","last_active":"2023-09-30T01:55:56.606462+0000","last_peered":"2023-09-30T01:55:56.606462+0000","last_clean":"2023-09-30T01:55:56.606462+0000","last_became_active":"2023-09-30T01:55:55.599019+0000","last_became_peered":"2023-09-30T01:55:55.599019+0000","last_unstale":"2023-09-30T01:55:56.606462+0000","last_undegraded":"2023-09-30T01:55:56.606462+0000","last_fullsized":"2023-09-30T01:55:56.606462+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:18:37.420194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744158+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:56:41.268990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.743652+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:23:52.565054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.093743+0000","last_change":"2023-09-30T01:55:56.090103+0000","last_active":"2023-09-30T01:55:56.093743+0000","last_peered":"2023-09-30T01:55:56.093743+0000","last_clean":"2023-09-30T01:55:56.093743+0000","last_became_active":"2023-09-30T01:55:56.089319+0000","last_became_peered":"2023-09-30T01:55:56.089319+0000","last_unstale":"2023-09-30T01:55:56.093743+0000","last_undegraded":"2023-09-30T01:55:56.093743+0000","last_fullsized":"2023-09-30T01:55:56.093743+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:29.888440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.738825+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:14:41.570446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606572+0000","last_change":"2023-09-30T01:55:55.597415+0000","last_active":"2023-09-30T01:55:56.606572+0000","last_peered":"2023-09-30T01:55:56.606572+0000","last_clean":"2023-09-30T01:55:56.606572+0000","last_became_active":"2023-09-30T01:55:55.596836+0000","last_became_peered":"2023-09-30T01:55:55.596836+0000","last_unstale":"2023-09-30T01:55:56.606572+0000","last_undegraded":"2023-09-30T01:55:56.606572+0000","last_fullsized":"2023-09-30T01:55:56.606572+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:29.888440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.746047+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:03:41.802753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":14,"state":"active+clean","last_fresh":"2023-09-30T01:55:55.599386+0000","last_change":"2023-09-30T01:55:55.597920+0000","last_active":"2023-09-30T01:55:55.599386+0000","last_peered":"2023-09-30T01:55:55.599386+0000","last_clean":"2023-09-30T01:55:55.599386+0000","last_became_active":"2023-09-30T01:55:55.597433+0000","last_became_peered":"2023-09-30T01:55:55.597433+0000","last_unstale":"2023-09-30T01:55:55.599386+0000","last_undegraded":"2023-09-30T01:55:55.599386+0000","last_fullsized":"2023-09-30T01:55:55.599386+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:11:56.914296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739003+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:23:52.565054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":15,"state":"active+clean","last_fresh":"2023-09-30T01:55:56.606498+0000","last_change":"2023-09-30T01:55:55.599569+0000","last_active":"2023-09-30T01:55:56.606498+0000","last_peered":"2023-09-30T01:55:56.606498+0000","last_clean":"2023-09-30T01:55:56.606498+0000","last_became_active":"2023-09-30T01:55:55.599037+0000","last_became_peered":"2023-09-30T01:55:55.599037+0000","last_unstale":"2023-09-30T01:55:56.606498+0000","last_undegraded":"2023-09-30T01:55:56.606498+0000","last_fullsized":"2023-09-30T01:55:56.606498+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:03:37.621500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745191+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:08:09.194250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744121+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:29.325058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.745614+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:45:38.723185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.739651+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:56:31.926088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.746863+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:14:41.570446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.741312+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:19.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.747609+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:22.053979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.748200+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.740994+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:51:07.989623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.746549+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:41:38.413142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.744737+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:57.376422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-09-30T01:55:59.730651+0000","last_change":"2023-09-30T01:55:59.730651+0000","last_active":"2023-09-30T01:55:59.730651+0000","last_peered":"2023-09-30T01:55:59.730651+0000","last_clean":"2023-09-30T01:55:59.730651+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:59.730651+0000","last_undegraded":"2023-09-30T01:55:59.730651+0000","last_fullsized":"2023-09-30T01:55:59.730651+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-09-30T01:55:58.717648+0000","last_change":"2023-09-30T01:55:58.740814+0000","last_active":"2023-09-30T01:55:58.717648+0000","last_peered":"2023-09-30T01:55:58.717648+0000","last_clean":"2023-09-30T01:55:58.717648+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-09-30T01:55:58.717648+0000","last_undegraded":"2023-09-30T01:55:58.717648+0000","last_fullsized":"2023-09-30T01:55:58.717648+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:35:45.967065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":7760,"kb_used_data":136,"kb_used_omap":0,"kb_used_meta":7616,"kb_avail":94364080,"statfs":{"total":96636764160,"available":96628817920,"internally_reserved":0,"allocated":139264,"data_stored":45248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":7798784},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8832,"kb_used_data":696,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363008,"statfs":{"total":96636764160,"available":96627720192,"internally_reserved":0,"allocated":712704,"data_stored":626367,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54500000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8836,"kb_used_data":700,"kb_used_omap":0,"kb_used_meta":8128,"kb_avail":94363004,"statfs":{"total":96636764160,"available":96627716096,"internally_reserved":0,"allocated":716800,"data_stored":627178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8323072},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":11916,"kb_used_data":132,"kb_used_omap":0,"kb_used_meta":11776,"kb_avail":94359924,"statfs":{"total":96636764160,"available":96624562176,"internally_reserved":0,"allocated":135168,"data_stored":44437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12058624},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74199999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T01:56:07.508 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T01:56:07.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.619+0000 7f89a96b0700 1 Processor -- start 2023-09-30T01:56:07.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a96b0700 1 -- start start 2023-09-30T01:56:07.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a96b0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89a40b2730 0x7f89a4149620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:07.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a96b0700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a413dbd0 con 0x7f89a40700c0 2023-09-30T01:56:07.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a96b0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a40a6d80 con 0x7f89a41412d0 2023-09-30T01:56:07.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a96b0700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40a7f50 con 0x7f89a40b2730 2023-09-30T01:56:07.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89a40b2730 0x7f89a4149620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:07.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a2ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f89a40700c0 0x7f89a40a8b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53130/0 (socket says 172.21.15.55:53130) 2023-09-30T01:56:07.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a2ffd700 1 -- 172.21.15.55:0/4112325946 learned_addr learned my addr 172.21.15.55:0/4112325946 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:07.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a1ffb700 1 -- 172.21.15.55:0/4112325946 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3058987984 0 0) 0x7f89a413dbd0 con 0x7f89a40700c0 2023-09-30T01:56:07.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a1ffb700 1 -- 172.21.15.55:0/4112325946 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f898c003570 con 0x7f89a40700c0 2023-09-30T01:56:07.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a1ffb700 1 -- 172.21.15.55:0/4112325946 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3824508696 0 0) 0x7f89a40a6d80 con 0x7f89a41412d0 2023-09-30T01:56:07.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a1ffb700 1 -- 172.21.15.55:0/4112325946 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89a413dbd0 con 0x7f89a41412d0 2023-09-30T01:56:07.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a37fe700 1 -- 172.21.15.55:0/4112325946 >> v1:172.21.15.133:6789/0 conn(0x7f89a41412d0 legacy=0x7f89a41419a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:07.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a37fe700 1 -- 172.21.15.55:0/4112325946 >> v1:172.21.15.55:6789/0 conn(0x7f89a40700c0 legacy=0x7f89a40a8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:07.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a37fe700 1 -- 172.21.15.55:0/4112325946 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a40a7040 con 0x7f89a40b2730 2023-09-30T01:56:07.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a37fe700 1 --2- 172.21.15.55:0/4112325946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89a40b2730 0x7f89a4149620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f899c009e90 tx=0x7f899c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eabb8bacd2b36846 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:07.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a1ffb700 1 -- 172.21.15.55:0/4112325946 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899c00e070 con 0x7f89a40b2730 2023-09-30T01:56:07.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a1ffb700 1 -- 172.21.15.55:0/4112325946 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f899c00b870 con 0x7f89a40b2730 2023-09-30T01:56:07.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a1ffb700 1 -- 172.21.15.55:0/4112325946 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994001470 con 0x7f89a40b2730 2023-09-30T01:56:07.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a96b0700 1 -- 172.21.15.55:0/4112325946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89a40b2730 msgr2=0x7f89a4149620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a96b0700 1 --2- 172.21.15.55:0/4112325946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89a40b2730 0x7f89a4149620 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f899c009e90 tx=0x7f899c009780 comp rx=0 tx=0).stop 2023-09-30T01:56:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a96b0700 1 -- 172.21.15.55:0/4112325946 shutdown_connections 2023-09-30T01:56:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a96b0700 1 --2- 172.21.15.55:0/4112325946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89a40b2730 0x7f89a4149620 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a96b0700 1 -- 172.21.15.55:0/4112325946 >> 172.21.15.55:0/4112325946 conn(0x7f89a40b3060 msgr2=0x7f89a40b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a96b0700 1 -- 172.21.15.55:0/4112325946 shutdown_connections 2023-09-30T01:56:07.630 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.623+0000 7f89a96b0700 1 -- 172.21.15.55:0/4112325946 wait complete. 2023-09-30T01:56:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.627+0000 7f89a96b0700 1 Processor -- start 2023-09-30T01:56:07.631 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.627+0000 7f89a96b0700 1 -- start start 2023-09-30T01:56:07.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.627+0000 7f89a96b0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89a40700c0 0x7f89a40ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:07.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.627+0000 7f89a96b0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89a40b2730 0x7f89a40aeac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:07.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.627+0000 7f89a96b0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89a41412d0 0x7f89a40abeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:07.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.627+0000 7f89a96b0700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40af000 con 0x7f89a40700c0 2023-09-30T01:56:07.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.627+0000 7f89a96b0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40addf0 con 0x7f89a40b2730 2023-09-30T01:56:07.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.627+0000 7f89a96b0700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a40acb40 con 0x7f89a41412d0 2023-09-30T01:56:07.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.627+0000 7f89a2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89a40700c0 0x7f89a40ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:07.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.627+0000 7f89a37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89a41412d0 0x7f89a40abeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:07.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.627+0000 7f89a37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89a41412d0 0x7f89a40abeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43748/0 (socket says 172.21.15.55:43748) 2023-09-30T01:56:07.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.627+0000 7f89a2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89a40700c0 0x7f89a40ad4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39878/0 (socket says 172.21.15.55:39878) 2023-09-30T01:56:07.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.627+0000 7f89a37fe700 1 -- 172.21.15.55:0/2906580981 learned_addr learned my addr 172.21.15.55:0/2906580981 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:07.633 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.627+0000 7f89a27fc700 1 --2- 172.21.15.55:0/2906580981 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89a40b2730 0x7f89a40aeac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:07.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.631+0000 7f89a2ffd700 1 -- 172.21.15.55:0/2906580981 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89a41412d0 msgr2=0x7f89a40abeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:07.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.631+0000 7f89a2ffd700 1 --2- 172.21.15.55:0/2906580981 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89a41412d0 0x7f89a40abeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:07.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.631+0000 7f89a2ffd700 1 -- 172.21.15.55:0/2906580981 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89a40b2730 msgr2=0x7f89a40aeac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:07.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.631+0000 7f89a2ffd700 1 --2- 172.21.15.55:0/2906580981 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89a40b2730 0x7f89a40aeac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:07.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.631+0000 7f89a2ffd700 1 -- 172.21.15.55:0/2906580981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f899c009a20 con 0x7f89a40700c0 2023-09-30T01:56:07.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.631+0000 7f89a37fe700 1 --2- 172.21.15.55:0/2906580981 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89a41412d0 0x7f89a40abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:07.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.631+0000 7f89a2ffd700 1 --2- 172.21.15.55:0/2906580981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89a40700c0 0x7f89a40ad4c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f899400cb60 tx=0x7f8994001b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:07.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.631+0000 7f898affd700 1 -- 172.21.15.55:0/2906580981 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f899400ce70 con 0x7f89a40700c0 2023-09-30T01:56:07.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.631+0000 7f898affd700 1 -- 172.21.15.55:0/2906580981 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8994007360 con 0x7f89a40700c0 2023-09-30T01:56:07.635 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.631+0000 7f89a96b0700 1 -- 172.21.15.55:0/2906580981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a40ace00 con 0x7f89a40700c0 2023-09-30T01:56:07.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.631+0000 7f898affd700 1 -- 172.21.15.55:0/2906580981 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994004830 con 0x7f89a40700c0 2023-09-30T01:56:07.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.631+0000 7f89a96b0700 1 -- 172.21.15.55:0/2906580981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a40ab140 con 0x7f89a40700c0 2023-09-30T01:56:07.636 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.631+0000 7f89a96b0700 1 -- 172.21.15.55:0/2906580981 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a40abc70 con 0x7f89a40700c0 2023-09-30T01:56:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.635+0000 7f898affd700 1 -- 172.21.15.55:0/2906580981 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f899400a5d0 con 0x7f89a40700c0 2023-09-30T01:56:07.638 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.635+0000 7f898affd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.635+0000 7f898affd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.635+0000 7f898affd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.635+0000 7f898affd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.635+0000 7f898affd700 1 --2- 172.21.15.55:0/2906580981 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f899008e8b0 0x7f8990090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.635+0000 7f89a27fc700 1 --2- 172.21.15.55:0/2906580981 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f899008e8b0 0x7f8990090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:07.639 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.635+0000 7f898affd700 1 -- 172.21.15.55:0/2906580981 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f89940b46c0 con 0x7f89a40700c0 2023-09-30T01:56:07.640 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.635+0000 7f89a27fc700 1 --2- 172.21.15.55:0/2906580981 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f899008e8b0 0x7f8990090d60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f89a413d7f0 tx=0x7f8998007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:07.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.639+0000 7f898affd700 1 -- 172.21.15.55:0/2906580981 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f89940850f0 con 0x7f89a40700c0 2023-09-30T01:56:07.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.803+0000 7f89a96b0700 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2023-09-30T01:56:07.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.803+0000 7f89a96b0700 1 -- 172.21.15.55:0/2906580981 --> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f89a4064670 con 0x7f899008e8b0 2023-09-30T01:56:07.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.811+0000 7f898affd700 1 -- 172.21.15.55:0/2906580981 <== mgr.4103 v2:172.21.15.55:6808/27538 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+269409 (secure 0 0 0) 0x7f89a4064670 con 0x7f899008e8b0 2023-09-30T01:56:07.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.811+0000 7f898affd700 20 mgrc handle_command_reply tid 0 r 0 2023-09-30T01:56:07.817 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:07.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.815+0000 7f89a96b0700 10 mgrc shutdown 2023-09-30T01:56:07.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.815+0000 7f89a96b0700 1 -- 172.21.15.55:0/2906580981 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f899008e8b0 msgr2=0x7f8990090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.815+0000 7f89a96b0700 1 --2- 172.21.15.55:0/2906580981 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f899008e8b0 0x7f8990090d60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f89a413d7f0 tx=0x7f8998007d50 comp rx=0 tx=0).stop 2023-09-30T01:56:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.815+0000 7f89a96b0700 1 -- 172.21.15.55:0/2906580981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89a40700c0 msgr2=0x7f89a40ad4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.815+0000 7f89a96b0700 1 --2- 172.21.15.55:0/2906580981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89a40700c0 0x7f89a40ad4c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f899400cb60 tx=0x7f8994001b70 comp rx=0 tx=0).stop 2023-09-30T01:56:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.815+0000 7f89a96b0700 1 -- 172.21.15.55:0/2906580981 shutdown_connections 2023-09-30T01:56:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.815+0000 7f89a96b0700 1 --2- 172.21.15.55:0/2906580981 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f899008e8b0 0x7f8990090d60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.815+0000 7f89a96b0700 1 --2- 172.21.15.55:0/2906580981 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f89a41412d0 0x7f89a40abeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.815+0000 7f89a96b0700 1 --2- 172.21.15.55:0/2906580981 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f89a40b2730 0x7f89a40aeac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.815+0000 7f89a96b0700 1 --2- 172.21.15.55:0/2906580981 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f89a40700c0 0x7f89a40ad4c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.815+0000 7f89a96b0700 1 -- 172.21.15.55:0/2906580981 >> 172.21.15.55:0/2906580981 conn(0x7f89a40b3060 msgr2=0x7f89a413f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.815+0000 7f89a96b0700 1 -- 172.21.15.55:0/2906580981 shutdown_connections 2023-09-30T01:56:07.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.815+0000 7f89a96b0700 1 -- 172.21.15.55:0/2906580981 wait complete. 2023-09-30T01:56:07.822 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-09-30T01:56:07.833 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2023-09-30T01:56:07.031194+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":157,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":38608,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":36672,"kb_avail":377448752,"statfs":{"total":386547056640,"available":386507522048,"internally_reserved":0,"allocated":1949696,"data_stored":1425218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37552128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.276048"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145491+0000","last_change":"2023-09-30T01:56:00.139640+0000","last_active":"2023-09-30T01:56:00.145491+0000","last_peered":"2023-09-30T01:56:00.145491+0000","last_clean":"2023-09-30T01:56:00.145491+0000","last_became_active":"2023-09-30T01:56:00.139371+0000","last_became_peered":"2023-09-30T01:56:00.139371+0000","last_unstale":"2023-09-30T01:56:00.145491+0000","last_undegraded":"2023-09-30T01:56:00.145491+0000","last_fullsized":"2023-09-30T01:56:00.145491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:24:15.189346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150056+0000","last_change":"2023-09-30T01:56:00.148833+0000","last_active":"2023-09-30T01:56:00.150056+0000","last_peered":"2023-09-30T01:56:00.150056+0000","last_clean":"2023-09-30T01:56:00.150056+0000","last_became_active":"2023-09-30T01:56:00.148030+0000","last_became_peered":"2023-09-30T01:56:00.148030+0000","last_unstale":"2023-09-30T01:56:00.150056+0000","last_undegraded":"2023-09-30T01:56:00.150056+0000","last_fullsized":"2023-09-30T01:56:00.150056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:32:23.254275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150085+0000","last_change":"2023-09-30T01:56:00.148504+0000","last_active":"2023-09-30T01:56:00.150085+0000","last_peered":"2023-09-30T01:56:00.150085+0000","last_clean":"2023-09-30T01:56:00.150085+0000","last_became_active":"2023-09-30T01:56:00.148039+0000","last_became_peered":"2023-09-30T01:56:00.148039+0000","last_unstale":"2023-09-30T01:56:00.150085+0000","last_undegraded":"2023-09-30T01:56:00.150085+0000","last_fullsized":"2023-09-30T01:56:00.150085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:30:20.150172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155598+0000","last_change":"2023-09-30T01:56:00.148000+0000","last_active":"2023-09-30T01:56:00.155598+0000","last_peered":"2023-09-30T01:56:00.155598+0000","last_clean":"2023-09-30T01:56:00.155598+0000","last_became_active":"2023-09-30T01:56:00.147578+0000","last_became_peered":"2023-09-30T01:56:00.147578+0000","last_unstale":"2023-09-30T01:56:00.155598+0000","last_undegraded":"2023-09-30T01:56:00.155598+0000","last_fullsized":"2023-09-30T01:56:00.155598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:04.461529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.149753+0000","last_change":"2023-09-30T01:56:00.145999+0000","last_active":"2023-09-30T01:56:00.149753+0000","last_peered":"2023-09-30T01:56:00.149753+0000","last_clean":"2023-09-30T01:56:00.149753+0000","last_became_active":"2023-09-30T01:56:00.145352+0000","last_became_peered":"2023-09-30T01:56:00.145352+0000","last_unstale":"2023-09-30T01:56:00.149753+0000","last_undegraded":"2023-09-30T01:56:00.149753+0000","last_fullsized":"2023-09-30T01:56:00.149753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:31:18.857698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148578+0000","last_change":"2023-09-30T01:56:00.143060+0000","last_active":"2023-09-30T01:56:00.148578+0000","last_peered":"2023-09-30T01:56:00.148578+0000","last_clean":"2023-09-30T01:56:00.148578+0000","last_became_active":"2023-09-30T01:56:00.142616+0000","last_became_peered":"2023-09-30T01:56:00.142616+0000","last_unstale":"2023-09-30T01:56:00.148578+0000","last_undegraded":"2023-09-30T01:56:00.148578+0000","last_fullsized":"2023-09-30T01:56:00.148578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:41:29.282659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148779+0000","last_change":"2023-09-30T01:56:00.143260+0000","last_active":"2023-09-30T01:56:00.148779+0000","last_peered":"2023-09-30T01:56:00.148779+0000","last_clean":"2023-09-30T01:56:00.148779+0000","last_became_active":"2023-09-30T01:56:00.142575+0000","last_became_peered":"2023-09-30T01:56:00.142575+0000","last_unstale":"2023-09-30T01:56:00.148779+0000","last_undegraded":"2023-09-30T01:56:00.148779+0000","last_fullsized":"2023-09-30T01:56:00.148779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:37.790754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143024+0000","last_change":"2023-09-30T01:56:00.137083+0000","last_active":"2023-09-30T01:56:00.143024+0000","last_peered":"2023-09-30T01:56:00.143024+0000","last_clean":"2023-09-30T01:56:00.143024+0000","last_became_active":"2023-09-30T01:56:00.136730+0000","last_became_peered":"2023-09-30T01:56:00.136730+0000","last_unstale":"2023-09-30T01:56:00.143024+0000","last_undegraded":"2023-09-30T01:56:00.143024+0000","last_fullsized":"2023-09-30T01:56:00.143024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:04.461529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145712+0000","last_change":"2023-09-30T01:56:00.141053+0000","last_active":"2023-09-30T01:56:00.145712+0000","last_peered":"2023-09-30T01:56:00.145712+0000","last_clean":"2023-09-30T01:56:00.145712+0000","last_became_active":"2023-09-30T01:56:00.140018+0000","last_became_peered":"2023-09-30T01:56:00.140018+0000","last_unstale":"2023-09-30T01:56:00.145712+0000","last_undegraded":"2023-09-30T01:56:00.145712+0000","last_fullsized":"2023-09-30T01:56:00.145712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:14:33.172803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.152909+0000","last_change":"2023-09-30T01:56:00.146386+0000","last_active":"2023-09-30T01:56:00.152909+0000","last_peered":"2023-09-30T01:56:00.152909+0000","last_clean":"2023-09-30T01:56:00.152909+0000","last_became_active":"2023-09-30T01:56:00.146117+0000","last_became_peered":"2023-09-30T01:56:00.146117+0000","last_unstale":"2023-09-30T01:56:00.152909+0000","last_undegraded":"2023-09-30T01:56:00.152909+0000","last_fullsized":"2023-09-30T01:56:00.152909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:55:44.330139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155662+0000","last_change":"2023-09-30T01:56:00.150324+0000","last_active":"2023-09-30T01:56:00.155662+0000","last_peered":"2023-09-30T01:56:00.155662+0000","last_clean":"2023-09-30T01:56:00.155662+0000","last_became_active":"2023-09-30T01:56:00.150121+0000","last_became_peered":"2023-09-30T01:56:00.150121+0000","last_unstale":"2023-09-30T01:56:00.155662+0000","last_undegraded":"2023-09-30T01:56:00.155662+0000","last_fullsized":"2023-09-30T01:56:00.155662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:37:10.888007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145198+0000","last_change":"2023-09-30T01:56:00.135304+0000","last_active":"2023-09-30T01:56:00.145198+0000","last_peered":"2023-09-30T01:56:00.145198+0000","last_clean":"2023-09-30T01:56:00.145198+0000","last_became_active":"2023-09-30T01:56:00.134990+0000","last_became_peered":"2023-09-30T01:56:00.134990+0000","last_unstale":"2023-09-30T01:56:00.145198+0000","last_undegraded":"2023-09-30T01:56:00.145198+0000","last_fullsized":"2023-09-30T01:56:00.145198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:26:31.604340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145469+0000","last_change":"2023-09-30T01:56:00.139589+0000","last_active":"2023-09-30T01:56:00.145469+0000","last_peered":"2023-09-30T01:56:00.145469+0000","last_clean":"2023-09-30T01:56:00.145469+0000","last_became_active":"2023-09-30T01:56:00.139313+0000","last_became_peered":"2023-09-30T01:56:00.139313+0000","last_unstale":"2023-09-30T01:56:00.145469+0000","last_undegraded":"2023-09-30T01:56:00.145469+0000","last_fullsized":"2023-09-30T01:56:00.145469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:20.598891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143004+0000","last_change":"2023-09-30T01:56:00.136514+0000","last_active":"2023-09-30T01:56:00.143004+0000","last_peered":"2023-09-30T01:56:00.143004+0000","last_clean":"2023-09-30T01:56:00.143004+0000","last_became_active":"2023-09-30T01:56:00.136143+0000","last_became_peered":"2023-09-30T01:56:00.136143+0000","last_unstale":"2023-09-30T01:56:00.143004+0000","last_undegraded":"2023-09-30T01:56:00.143004+0000","last_fullsized":"2023-09-30T01:56:00.143004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:27:08.978174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142786+0000","last_change":"2023-09-30T01:56:00.135556+0000","last_active":"2023-09-30T01:56:00.142786+0000","last_peered":"2023-09-30T01:56:00.142786+0000","last_clean":"2023-09-30T01:56:00.142786+0000","last_became_active":"2023-09-30T01:56:00.135247+0000","last_became_peered":"2023-09-30T01:56:00.135247+0000","last_unstale":"2023-09-30T01:56:00.142786+0000","last_undegraded":"2023-09-30T01:56:00.142786+0000","last_fullsized":"2023-09-30T01:56:00.142786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:55:44.330139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143006+0000","last_change":"2023-09-30T01:56:00.136819+0000","last_active":"2023-09-30T01:56:00.143006+0000","last_peered":"2023-09-30T01:56:00.143006+0000","last_clean":"2023-09-30T01:56:00.143006+0000","last_became_active":"2023-09-30T01:56:00.136318+0000","last_became_peered":"2023-09-30T01:56:00.136318+0000","last_unstale":"2023-09-30T01:56:00.143006+0000","last_undegraded":"2023-09-30T01:56:00.143006+0000","last_fullsized":"2023-09-30T01:56:00.143006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:37:10.888007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.138731+0000","last_change":"2023-09-30T01:56:00.132691+0000","last_active":"2023-09-30T01:56:00.138731+0000","last_peered":"2023-09-30T01:56:00.138731+0000","last_clean":"2023-09-30T01:56:00.138731+0000","last_became_active":"2023-09-30T01:56:00.132457+0000","last_became_peered":"2023-09-30T01:56:00.132457+0000","last_unstale":"2023-09-30T01:56:00.138731+0000","last_undegraded":"2023-09-30T01:56:00.138731+0000","last_fullsized":"2023-09-30T01:56:00.138731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:31:18.857698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148808+0000","last_change":"2023-09-30T01:56:00.145655+0000","last_active":"2023-09-30T01:56:00.148808+0000","last_peered":"2023-09-30T01:56:00.148808+0000","last_clean":"2023-09-30T01:56:00.148808+0000","last_became_active":"2023-09-30T01:56:00.145375+0000","last_became_peered":"2023-09-30T01:56:00.145375+0000","last_unstale":"2023-09-30T01:56:00.148808+0000","last_undegraded":"2023-09-30T01:56:00.148808+0000","last_fullsized":"2023-09-30T01:56:00.148808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:31.249335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145423+0000","last_change":"2023-09-30T01:56:00.138951+0000","last_active":"2023-09-30T01:56:00.145423+0000","last_peered":"2023-09-30T01:56:00.145423+0000","last_clean":"2023-09-30T01:56:00.145423+0000","last_became_active":"2023-09-30T01:56:00.138624+0000","last_became_peered":"2023-09-30T01:56:00.138624+0000","last_unstale":"2023-09-30T01:56:00.145423+0000","last_undegraded":"2023-09-30T01:56:00.145423+0000","last_fullsized":"2023-09-30T01:56:00.145423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:06:01.640504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155882+0000","last_change":"2023-09-30T01:56:00.150510+0000","last_active":"2023-09-30T01:56:00.155882+0000","last_peered":"2023-09-30T01:56:00.155882+0000","last_clean":"2023-09-30T01:56:00.155882+0000","last_became_active":"2023-09-30T01:56:00.150173+0000","last_became_peered":"2023-09-30T01:56:00.150173+0000","last_unstale":"2023-09-30T01:56:00.155882+0000","last_undegraded":"2023-09-30T01:56:00.155882+0000","last_fullsized":"2023-09-30T01:56:00.155882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:41:29.282659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143136+0000","last_change":"2023-09-30T01:56:00.138339+0000","last_active":"2023-09-30T01:56:00.143136+0000","last_peered":"2023-09-30T01:56:00.143136+0000","last_clean":"2023-09-30T01:56:00.143136+0000","last_became_active":"2023-09-30T01:56:00.138000+0000","last_became_peered":"2023-09-30T01:56:00.138000+0000","last_unstale":"2023-09-30T01:56:00.143136+0000","last_undegraded":"2023-09-30T01:56:00.143136+0000","last_fullsized":"2023-09-30T01:56:00.143136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:50:54.628959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157391+0000","last_change":"2023-09-30T01:56:00.152748+0000","last_active":"2023-09-30T01:56:00.157391+0000","last_peered":"2023-09-30T01:56:00.157391+0000","last_clean":"2023-09-30T01:56:00.157391+0000","last_became_active":"2023-09-30T01:56:00.152435+0000","last_became_peered":"2023-09-30T01:56:00.152435+0000","last_unstale":"2023-09-30T01:56:00.157391+0000","last_undegraded":"2023-09-30T01:56:00.157391+0000","last_fullsized":"2023-09-30T01:56:00.157391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:08.611396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150804+0000","last_change":"2023-09-30T01:56:00.148868+0000","last_active":"2023-09-30T01:56:00.150804+0000","last_peered":"2023-09-30T01:56:00.150804+0000","last_clean":"2023-09-30T01:56:00.150804+0000","last_became_active":"2023-09-30T01:56:00.148611+0000","last_became_peered":"2023-09-30T01:56:00.148611+0000","last_unstale":"2023-09-30T01:56:00.150804+0000","last_undegraded":"2023-09-30T01:56:00.150804+0000","last_fullsized":"2023-09-30T01:56:00.150804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:20:12.451240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143087+0000","last_change":"2023-09-30T01:56:00.137850+0000","last_active":"2023-09-30T01:56:00.143087+0000","last_peered":"2023-09-30T01:56:00.143087+0000","last_clean":"2023-09-30T01:56:00.143087+0000","last_became_active":"2023-09-30T01:56:00.137521+0000","last_became_peered":"2023-09-30T01:56:00.137521+0000","last_unstale":"2023-09-30T01:56:00.143087+0000","last_undegraded":"2023-09-30T01:56:00.143087+0000","last_fullsized":"2023-09-30T01:56:00.143087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:12:45.050840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155855+0000","last_change":"2023-09-30T01:56:00.152024+0000","last_active":"2023-09-30T01:56:00.155855+0000","last_peered":"2023-09-30T01:56:00.155855+0000","last_clean":"2023-09-30T01:56:00.155855+0000","last_became_active":"2023-09-30T01:56:00.150705+0000","last_became_peered":"2023-09-30T01:56:00.150705+0000","last_unstale":"2023-09-30T01:56:00.155855+0000","last_undegraded":"2023-09-30T01:56:00.155855+0000","last_fullsized":"2023-09-30T01:56:00.155855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:27:08.978174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.149819+0000","last_change":"2023-09-30T01:56:00.135734+0000","last_active":"2023-09-30T01:56:00.149819+0000","last_peered":"2023-09-30T01:56:00.149819+0000","last_clean":"2023-09-30T01:56:00.149819+0000","last_became_active":"2023-09-30T01:56:00.134747+0000","last_became_peered":"2023-09-30T01:56:00.134747+0000","last_unstale":"2023-09-30T01:56:00.149819+0000","last_undegraded":"2023-09-30T01:56:00.149819+0000","last_fullsized":"2023-09-30T01:56:00.149819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:10:11.219000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143114+0000","last_change":"2023-09-30T01:56:00.138167+0000","last_active":"2023-09-30T01:56:00.143114+0000","last_peered":"2023-09-30T01:56:00.143114+0000","last_clean":"2023-09-30T01:56:00.143114+0000","last_became_active":"2023-09-30T01:56:00.137821+0000","last_became_peered":"2023-09-30T01:56:00.137821+0000","last_unstale":"2023-09-30T01:56:00.143114+0000","last_undegraded":"2023-09-30T01:56:00.143114+0000","last_fullsized":"2023-09-30T01:56:00.143114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:11:10.730984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150406+0000","last_change":"2023-09-30T01:56:00.138769+0000","last_active":"2023-09-30T01:56:00.150406+0000","last_peered":"2023-09-30T01:56:00.150406+0000","last_clean":"2023-09-30T01:56:00.150406+0000","last_became_active":"2023-09-30T01:56:00.138302+0000","last_became_peered":"2023-09-30T01:56:00.138302+0000","last_unstale":"2023-09-30T01:56:00.150406+0000","last_undegraded":"2023-09-30T01:56:00.150406+0000","last_fullsized":"2023-09-30T01:56:00.150406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:31.820081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148717+0000","last_change":"2023-09-30T01:56:00.145007+0000","last_active":"2023-09-30T01:56:00.148717+0000","last_peered":"2023-09-30T01:56:00.148717+0000","last_clean":"2023-09-30T01:56:00.148717+0000","last_became_active":"2023-09-30T01:56:00.144721+0000","last_became_peered":"2023-09-30T01:56:00.144721+0000","last_unstale":"2023-09-30T01:56:00.148717+0000","last_undegraded":"2023-09-30T01:56:00.148717+0000","last_fullsized":"2023-09-30T01:56:00.148717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:27:08.978174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155951+0000","last_change":"2023-09-30T01:56:00.152139+0000","last_active":"2023-09-30T01:56:00.155951+0000","last_peered":"2023-09-30T01:56:00.155951+0000","last_clean":"2023-09-30T01:56:00.155951+0000","last_became_active":"2023-09-30T01:56:00.150862+0000","last_became_peered":"2023-09-30T01:56:00.150862+0000","last_unstale":"2023-09-30T01:56:00.155951+0000","last_undegraded":"2023-09-30T01:56:00.155951+0000","last_fullsized":"2023-09-30T01:56:00.155951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:42.194028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157422+0000","last_change":"2023-09-30T01:56:00.154368+0000","last_active":"2023-09-30T01:56:00.157422+0000","last_peered":"2023-09-30T01:56:00.157422+0000","last_clean":"2023-09-30T01:56:00.157422+0000","last_became_active":"2023-09-30T01:56:00.153986+0000","last_became_peered":"2023-09-30T01:56:00.153986+0000","last_unstale":"2023-09-30T01:56:00.157422+0000","last_undegraded":"2023-09-30T01:56:00.157422+0000","last_fullsized":"2023-09-30T01:56:00.157422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:51:06.725801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142974+0000","last_change":"2023-09-30T01:56:00.136648+0000","last_active":"2023-09-30T01:56:00.142974+0000","last_peered":"2023-09-30T01:56:00.142974+0000","last_clean":"2023-09-30T01:56:00.142974+0000","last_became_active":"2023-09-30T01:56:00.136284+0000","last_became_peered":"2023-09-30T01:56:00.136284+0000","last_unstale":"2023-09-30T01:56:00.142974+0000","last_undegraded":"2023-09-30T01:56:00.142974+0000","last_fullsized":"2023-09-30T01:56:00.142974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:37.790754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157601+0000","last_change":"2023-09-30T01:56:00.154844+0000","last_active":"2023-09-30T01:56:00.157601+0000","last_peered":"2023-09-30T01:56:00.157601+0000","last_clean":"2023-09-30T01:56:00.157601+0000","last_became_active":"2023-09-30T01:56:00.154532+0000","last_became_peered":"2023-09-30T01:56:00.154532+0000","last_unstale":"2023-09-30T01:56:00.157601+0000","last_undegraded":"2023-09-30T01:56:00.157601+0000","last_fullsized":"2023-09-30T01:56:00.157601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:16:34.209458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.144813+0000","last_change":"2023-09-30T01:55:59.785778+0000","last_active":"2023-09-30T01:56:00.144813+0000","last_peered":"2023-09-30T01:56:00.144813+0000","last_clean":"2023-09-30T01:56:00.144813+0000","last_became_active":"2023-09-30T01:55:59.785425+0000","last_became_peered":"2023-09-30T01:55:59.785425+0000","last_unstale":"2023-09-30T01:56:00.144813+0000","last_undegraded":"2023-09-30T01:56:00.144813+0000","last_fullsized":"2023-09-30T01:56:00.144813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:27:45.755265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148718+0000","last_change":"2023-09-30T01:56:00.144232+0000","last_active":"2023-09-30T01:56:00.148718+0000","last_peered":"2023-09-30T01:56:00.148718+0000","last_clean":"2023-09-30T01:56:00.148718+0000","last_became_active":"2023-09-30T01:56:00.143962+0000","last_became_peered":"2023-09-30T01:56:00.143962+0000","last_unstale":"2023-09-30T01:56:00.148718+0000","last_undegraded":"2023-09-30T01:56:00.148718+0000","last_fullsized":"2023-09-30T01:56:00.148718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:02:54.801532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.114192+0000","last_change":"2023-09-30T01:55:59.782826+0000","last_active":"2023-09-30T01:56:00.114192+0000","last_peered":"2023-09-30T01:56:00.114192+0000","last_clean":"2023-09-30T01:56:00.114192+0000","last_became_active":"2023-09-30T01:55:59.781535+0000","last_became_peered":"2023-09-30T01:55:59.781535+0000","last_unstale":"2023-09-30T01:56:00.114192+0000","last_undegraded":"2023-09-30T01:56:00.114192+0000","last_fullsized":"2023-09-30T01:56:00.114192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:18:41.601447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157568+0000","last_change":"2023-09-30T01:56:00.154810+0000","last_active":"2023-09-30T01:56:00.157568+0000","last_peered":"2023-09-30T01:56:00.157568+0000","last_clean":"2023-09-30T01:56:00.157568+0000","last_became_active":"2023-09-30T01:56:00.154365+0000","last_became_peered":"2023-09-30T01:56:00.154365+0000","last_unstale":"2023-09-30T01:56:00.157568+0000","last_undegraded":"2023-09-30T01:56:00.157568+0000","last_fullsized":"2023-09-30T01:56:00.157568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:51:49.277142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127014+0000","last_change":"2023-09-30T01:55:59.787364+0000","last_active":"2023-09-30T01:56:00.127014+0000","last_peered":"2023-09-30T01:56:00.127014+0000","last_clean":"2023-09-30T01:56:00.127014+0000","last_became_active":"2023-09-30T01:55:59.786992+0000","last_became_peered":"2023-09-30T01:55:59.786992+0000","last_unstale":"2023-09-30T01:56:00.127014+0000","last_undegraded":"2023-09-30T01:56:00.127014+0000","last_fullsized":"2023-09-30T01:56:00.127014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:58:52.492307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157531+0000","last_change":"2023-09-30T01:56:00.154700+0000","last_active":"2023-09-30T01:56:00.157531+0000","last_peered":"2023-09-30T01:56:00.157531+0000","last_clean":"2023-09-30T01:56:00.157531+0000","last_became_active":"2023-09-30T01:56:00.154367+0000","last_became_peered":"2023-09-30T01:56:00.154367+0000","last_unstale":"2023-09-30T01:56:00.157531+0000","last_undegraded":"2023-09-30T01:56:00.157531+0000","last_fullsized":"2023-09-30T01:56:00.157531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:43.999938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.154011+0000","last_change":"2023-09-30T01:55:59.781281+0000","last_active":"2023-09-30T01:56:00.154011+0000","last_peered":"2023-09-30T01:56:00.154011+0000","last_clean":"2023-09-30T01:56:00.154011+0000","last_became_active":"2023-09-30T01:55:59.780907+0000","last_became_peered":"2023-09-30T01:55:59.780907+0000","last_unstale":"2023-09-30T01:56:00.154011+0000","last_undegraded":"2023-09-30T01:56:00.154011+0000","last_fullsized":"2023-09-30T01:56:00.154011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:54.314374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148023+0000","last_change":"2023-09-30T01:55:59.777405+0000","last_active":"2023-09-30T01:56:00.148023+0000","last_peered":"2023-09-30T01:56:00.148023+0000","last_clean":"2023-09-30T01:56:00.148023+0000","last_became_active":"2023-09-30T01:55:59.777101+0000","last_became_peered":"2023-09-30T01:55:59.777101+0000","last_unstale":"2023-09-30T01:56:00.148023+0000","last_undegraded":"2023-09-30T01:56:00.148023+0000","last_fullsized":"2023-09-30T01:56:00.148023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:14:32.159800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148667+0000","last_change":"2023-09-30T01:56:00.143954+0000","last_active":"2023-09-30T01:56:00.148667+0000","last_peered":"2023-09-30T01:56:00.148667+0000","last_clean":"2023-09-30T01:56:00.148667+0000","last_became_active":"2023-09-30T01:56:00.143607+0000","last_became_peered":"2023-09-30T01:56:00.143607+0000","last_unstale":"2023-09-30T01:56:00.148667+0000","last_undegraded":"2023-09-30T01:56:00.148667+0000","last_fullsized":"2023-09-30T01:56:00.148667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:08.611396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142086+0000","last_change":"2023-09-30T01:55:59.772042+0000","last_active":"2023-09-30T01:56:00.142086+0000","last_peered":"2023-09-30T01:56:00.142086+0000","last_clean":"2023-09-30T01:56:00.142086+0000","last_became_active":"2023-09-30T01:55:59.771218+0000","last_became_peered":"2023-09-30T01:55:59.771218+0000","last_unstale":"2023-09-30T01:56:00.142086+0000","last_undegraded":"2023-09-30T01:56:00.142086+0000","last_fullsized":"2023-09-30T01:56:00.142086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:58:12.527512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.153264+0000","last_change":"2023-09-30T01:56:00.146609+0000","last_active":"2023-09-30T01:56:00.153264+0000","last_peered":"2023-09-30T01:56:00.153264+0000","last_clean":"2023-09-30T01:56:00.153264+0000","last_became_active":"2023-09-30T01:56:00.146051+0000","last_became_peered":"2023-09-30T01:56:00.146051+0000","last_unstale":"2023-09-30T01:56:00.153264+0000","last_undegraded":"2023-09-30T01:56:00.153264+0000","last_fullsized":"2023-09-30T01:56:00.153264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:29:29.479636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.144756+0000","last_change":"2023-09-30T01:55:59.787370+0000","last_active":"2023-09-30T01:56:00.144756+0000","last_peered":"2023-09-30T01:56:00.144756+0000","last_clean":"2023-09-30T01:56:00.144756+0000","last_became_active":"2023-09-30T01:55:59.787002+0000","last_became_peered":"2023-09-30T01:55:59.787002+0000","last_unstale":"2023-09-30T01:56:00.144756+0000","last_undegraded":"2023-09-30T01:56:00.144756+0000","last_fullsized":"2023-09-30T01:56:00.144756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:49.528387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143061+0000","last_change":"2023-09-30T01:56:00.137829+0000","last_active":"2023-09-30T01:56:00.143061+0000","last_peered":"2023-09-30T01:56:00.143061+0000","last_clean":"2023-09-30T01:56:00.143061+0000","last_became_active":"2023-09-30T01:56:00.137459+0000","last_became_peered":"2023-09-30T01:56:00.137459+0000","last_unstale":"2023-09-30T01:56:00.143061+0000","last_undegraded":"2023-09-30T01:56:00.143061+0000","last_fullsized":"2023-09-30T01:56:00.143061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:10:44.425502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.131081+0000","last_change":"2023-09-30T01:55:59.783420+0000","last_active":"2023-09-30T01:56:00.131081+0000","last_peered":"2023-09-30T01:56:00.131081+0000","last_clean":"2023-09-30T01:56:00.131081+0000","last_became_active":"2023-09-30T01:55:59.783204+0000","last_became_peered":"2023-09-30T01:55:59.783204+0000","last_unstale":"2023-09-30T01:56:00.131081+0000","last_undegraded":"2023-09-30T01:56:00.131081+0000","last_fullsized":"2023-09-30T01:56:00.131081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:24:14.176343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145005+0000","last_change":"2023-09-30T01:56:00.134933+0000","last_active":"2023-09-30T01:56:00.145005+0000","last_peered":"2023-09-30T01:56:00.145005+0000","last_clean":"2023-09-30T01:56:00.145005+0000","last_became_active":"2023-09-30T01:56:00.134644+0000","last_became_peered":"2023-09-30T01:56:00.134644+0000","last_unstale":"2023-09-30T01:56:00.145005+0000","last_undegraded":"2023-09-30T01:56:00.145005+0000","last_fullsized":"2023-09-30T01:56:00.145005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:23.066981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.154766+0000","last_change":"2023-09-30T01:55:59.784616+0000","last_active":"2023-09-30T01:56:00.154766+0000","last_peered":"2023-09-30T01:56:00.154766+0000","last_clean":"2023-09-30T01:56:00.154766+0000","last_became_active":"2023-09-30T01:55:59.782834+0000","last_became_peered":"2023-09-30T01:55:59.782834+0000","last_unstale":"2023-09-30T01:56:00.154766+0000","last_undegraded":"2023-09-30T01:56:00.154766+0000","last_fullsized":"2023-09-30T01:56:00.154766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:51:07.989623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.152818+0000","last_change":"2023-09-30T01:56:00.145655+0000","last_active":"2023-09-30T01:56:00.152818+0000","last_peered":"2023-09-30T01:56:00.152818+0000","last_clean":"2023-09-30T01:56:00.152818+0000","last_became_active":"2023-09-30T01:56:00.145040+0000","last_became_peered":"2023-09-30T01:56:00.145040+0000","last_unstale":"2023-09-30T01:56:00.152818+0000","last_undegraded":"2023-09-30T01:56:00.152818+0000","last_fullsized":"2023-09-30T01:56:00.152818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:51:49.277142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127154+0000","last_change":"2023-09-30T01:55:59.777347+0000","last_active":"2023-09-30T01:56:00.127154+0000","last_peered":"2023-09-30T01:56:00.127154+0000","last_clean":"2023-09-30T01:56:00.127154+0000","last_became_active":"2023-09-30T01:55:59.777030+0000","last_became_peered":"2023-09-30T01:55:59.777030+0000","last_unstale":"2023-09-30T01:56:00.127154+0000","last_undegraded":"2023-09-30T01:56:00.127154+0000","last_fullsized":"2023-09-30T01:56:00.127154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:19.585888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142984+0000","last_change":"2023-09-30T01:56:00.136790+0000","last_active":"2023-09-30T01:56:00.142984+0000","last_peered":"2023-09-30T01:56:00.142984+0000","last_clean":"2023-09-30T01:56:00.142984+0000","last_became_active":"2023-09-30T01:56:00.136433+0000","last_became_peered":"2023-09-30T01:56:00.136433+0000","last_unstale":"2023-09-30T01:56:00.142984+0000","last_undegraded":"2023-09-30T01:56:00.142984+0000","last_fullsized":"2023-09-30T01:56:00.142984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:08.611396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129426+0000","last_change":"2023-09-30T01:55:59.782594+0000","last_active":"2023-09-30T01:56:00.129426+0000","last_peered":"2023-09-30T01:56:00.129426+0000","last_clean":"2023-09-30T01:56:00.129426+0000","last_became_active":"2023-09-30T01:55:59.782293+0000","last_became_peered":"2023-09-30T01:55:59.782293+0000","last_unstale":"2023-09-30T01:56:00.129426+0000","last_undegraded":"2023-09-30T01:56:00.129426+0000","last_fullsized":"2023-09-30T01:56:00.129426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:17:29.530403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.134113+0000","last_change":"2023-09-30T01:56:00.126377+0000","last_active":"2023-09-30T01:56:00.134113+0000","last_peered":"2023-09-30T01:56:00.134113+0000","last_clean":"2023-09-30T01:56:00.134113+0000","last_became_active":"2023-09-30T01:56:00.125998+0000","last_became_peered":"2023-09-30T01:56:00.125998+0000","last_unstale":"2023-09-30T01:56:00.134113+0000","last_undegraded":"2023-09-30T01:56:00.134113+0000","last_fullsized":"2023-09-30T01:56:00.134113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:58:13.540515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.130011+0000","last_change":"2023-09-30T01:55:59.783826+0000","last_active":"2023-09-30T01:56:00.130011+0000","last_peered":"2023-09-30T01:56:00.130011+0000","last_clean":"2023-09-30T01:56:00.130011+0000","last_became_active":"2023-09-30T01:55:59.783255+0000","last_became_peered":"2023-09-30T01:55:59.783255+0000","last_unstale":"2023-09-30T01:56:00.130011+0000","last_undegraded":"2023-09-30T01:56:00.130011+0000","last_fullsized":"2023-09-30T01:56:00.130011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:39.893506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155612+0000","last_change":"2023-09-30T01:56:00.149604+0000","last_active":"2023-09-30T01:56:00.155612+0000","last_peered":"2023-09-30T01:56:00.155612+0000","last_clean":"2023-09-30T01:56:00.155612+0000","last_became_active":"2023-09-30T01:56:00.147427+0000","last_became_peered":"2023-09-30T01:56:00.147427+0000","last_unstale":"2023-09-30T01:56:00.155612+0000","last_undegraded":"2023-09-30T01:56:00.155612+0000","last_fullsized":"2023-09-30T01:56:00.155612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:30:20.150172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":165,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.121950+0000","last_change":"2023-09-30T01:55:50.454189+0000","last_active":"2023-09-30T01:56:00.121950+0000","last_peered":"2023-09-30T01:56:00.121950+0000","last_clean":"2023-09-30T01:56:00.121950+0000","last_became_active":"2023-09-30T01:55:50.451349+0000","last_became_peered":"2023-09-30T01:55:50.451349+0000","last_unstale":"2023-09-30T01:56:00.121950+0000","last_undegraded":"2023-09-30T01:56:00.121950+0000","last_fullsized":"2023-09-30T01:56:00.121950+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:49.223709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:49.223709+0000","last_clean_scrub_stamp":"2023-09-30T01:55:49.223709+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:14:10.620817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127411+0000","last_change":"2023-09-30T01:55:55.596984+0000","last_active":"2023-09-30T01:56:00.127411+0000","last_peered":"2023-09-30T01:56:00.127411+0000","last_clean":"2023-09-30T01:56:00.127411+0000","last_became_active":"2023-09-30T01:55:55.596422+0000","last_became_peered":"2023-09-30T01:55:55.596422+0000","last_unstale":"2023-09-30T01:56:00.127411+0000","last_undegraded":"2023-09-30T01:56:00.127411+0000","last_fullsized":"2023-09-30T01:56:00.127411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:25.143805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.128684+0000","last_change":"2023-09-30T01:55:59.783410+0000","last_active":"2023-09-30T01:56:00.128684+0000","last_peered":"2023-09-30T01:56:00.128684+0000","last_clean":"2023-09-30T01:56:00.128684+0000","last_became_active":"2023-09-30T01:55:59.783095+0000","last_became_peered":"2023-09-30T01:55:59.783095+0000","last_unstale":"2023-09-30T01:56:00.128684+0000","last_undegraded":"2023-09-30T01:56:00.128684+0000","last_fullsized":"2023-09-30T01:56:00.128684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:56:41.268990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150125+0000","last_change":"2023-09-30T01:56:00.148605+0000","last_active":"2023-09-30T01:56:00.150125+0000","last_peered":"2023-09-30T01:56:00.150125+0000","last_clean":"2023-09-30T01:56:00.150125+0000","last_became_active":"2023-09-30T01:56:00.148253+0000","last_became_peered":"2023-09-30T01:56:00.148253+0000","last_unstale":"2023-09-30T01:56:00.150125+0000","last_undegraded":"2023-09-30T01:56:00.150125+0000","last_fullsized":"2023-09-30T01:56:00.150125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:34:19.920224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.132428+0000","last_change":"2023-09-30T01:55:55.599574+0000","last_active":"2023-09-30T01:56:00.132428+0000","last_peered":"2023-09-30T01:56:00.132428+0000","last_clean":"2023-09-30T01:56:00.132428+0000","last_became_active":"2023-09-30T01:55:55.598970+0000","last_became_peered":"2023-09-30T01:55:55.598970+0000","last_unstale":"2023-09-30T01:56:00.132428+0000","last_undegraded":"2023-09-30T01:56:00.132428+0000","last_fullsized":"2023-09-30T01:56:00.132428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:53.195170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.121970+0000","last_change":"2023-09-30T01:55:59.769829+0000","last_active":"2023-09-30T01:56:00.121970+0000","last_peered":"2023-09-30T01:56:00.121970+0000","last_clean":"2023-09-30T01:56:00.121970+0000","last_became_active":"2023-09-30T01:55:59.769519+0000","last_became_peered":"2023-09-30T01:55:59.769519+0000","last_unstale":"2023-09-30T01:56:00.121970+0000","last_undegraded":"2023-09-30T01:56:00.121970+0000","last_fullsized":"2023-09-30T01:56:00.121970+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:27:45.755265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157448+0000","last_change":"2023-09-30T01:56:00.154436+0000","last_active":"2023-09-30T01:56:00.157448+0000","last_peered":"2023-09-30T01:56:00.157448+0000","last_clean":"2023-09-30T01:56:00.157448+0000","last_became_active":"2023-09-30T01:56:00.154030+0000","last_became_peered":"2023-09-30T01:56:00.154030+0000","last_unstale":"2023-09-30T01:56:00.157448+0000","last_undegraded":"2023-09-30T01:56:00.157448+0000","last_fullsized":"2023-09-30T01:56:00.157448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:48:07.197805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.114706+0000","last_change":"2023-09-30T01:55:56.090039+0000","last_active":"2023-09-30T01:56:00.114706+0000","last_peered":"2023-09-30T01:56:00.114706+0000","last_clean":"2023-09-30T01:56:00.114706+0000","last_became_active":"2023-09-30T01:55:56.089292+0000","last_became_peered":"2023-09-30T01:55:56.089292+0000","last_unstale":"2023-09-30T01:56:00.114706+0000","last_undegraded":"2023-09-30T01:56:00.114706+0000","last_fullsized":"2023-09-30T01:56:00.114706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:04:26.068674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.122368+0000","last_change":"2023-09-30T01:55:59.768182+0000","last_active":"2023-09-30T01:56:00.122368+0000","last_peered":"2023-09-30T01:56:00.122368+0000","last_clean":"2023-09-30T01:56:00.122368+0000","last_became_active":"2023-09-30T01:55:59.767808+0000","last_became_peered":"2023-09-30T01:55:59.767808+0000","last_unstale":"2023-09-30T01:56:00.122368+0000","last_undegraded":"2023-09-30T01:56:00.122368+0000","last_fullsized":"2023-09-30T01:56:00.122368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:50:39.919553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.152919+0000","last_change":"2023-09-30T01:56:00.146334+0000","last_active":"2023-09-30T01:56:00.152919+0000","last_peered":"2023-09-30T01:56:00.152919+0000","last_clean":"2023-09-30T01:56:00.152919+0000","last_became_active":"2023-09-30T01:56:00.146038+0000","last_became_peered":"2023-09-30T01:56:00.146038+0000","last_unstale":"2023-09-30T01:56:00.152919+0000","last_undegraded":"2023-09-30T01:56:00.152919+0000","last_fullsized":"2023-09-30T01:56:00.152919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:32:23.254275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127237+0000","last_change":"2023-09-30T01:55:55.600117+0000","last_active":"2023-09-30T01:56:00.127237+0000","last_peered":"2023-09-30T01:56:00.127237+0000","last_clean":"2023-09-30T01:56:00.127237+0000","last_became_active":"2023-09-30T01:55:55.599019+0000","last_became_peered":"2023-09-30T01:55:55.599019+0000","last_unstale":"2023-09-30T01:56:00.127237+0000","last_undegraded":"2023-09-30T01:56:00.127237+0000","last_fullsized":"2023-09-30T01:56:00.127237+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:18:37.420194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127301+0000","last_change":"2023-09-30T01:55:59.777990+0000","last_active":"2023-09-30T01:56:00.127301+0000","last_peered":"2023-09-30T01:56:00.127301+0000","last_clean":"2023-09-30T01:56:00.127301+0000","last_became_active":"2023-09-30T01:55:59.777675+0000","last_became_peered":"2023-09-30T01:55:59.777675+0000","last_unstale":"2023-09-30T01:56:00.127301+0000","last_undegraded":"2023-09-30T01:56:00.127301+0000","last_fullsized":"2023-09-30T01:56:00.127301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:26:30.591338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150426+0000","last_change":"2023-09-30T01:56:00.139198+0000","last_active":"2023-09-30T01:56:00.150426+0000","last_peered":"2023-09-30T01:56:00.150426+0000","last_clean":"2023-09-30T01:56:00.150426+0000","last_became_active":"2023-09-30T01:56:00.138489+0000","last_became_peered":"2023-09-30T01:56:00.138489+0000","last_unstale":"2023-09-30T01:56:00.150426+0000","last_undegraded":"2023-09-30T01:56:00.150426+0000","last_fullsized":"2023-09-30T01:56:00.150426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:20:12.451240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129721+0000","last_change":"2023-09-30T01:55:59.785288+0000","last_active":"2023-09-30T01:56:00.129721+0000","last_peered":"2023-09-30T01:56:00.129721+0000","last_clean":"2023-09-30T01:56:00.129721+0000","last_became_active":"2023-09-30T01:55:59.784897+0000","last_became_peered":"2023-09-30T01:55:59.784897+0000","last_unstale":"2023-09-30T01:56:00.129721+0000","last_undegraded":"2023-09-30T01:56:00.129721+0000","last_fullsized":"2023-09-30T01:56:00.129721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:30:34.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.128920+0000","last_change":"2023-09-30T01:55:56.090103+0000","last_active":"2023-09-30T01:56:00.128920+0000","last_peered":"2023-09-30T01:56:00.128920+0000","last_clean":"2023-09-30T01:56:00.128920+0000","last_became_active":"2023-09-30T01:55:56.089319+0000","last_became_peered":"2023-09-30T01:55:56.089319+0000","last_unstale":"2023-09-30T01:56:00.128920+0000","last_undegraded":"2023-09-30T01:56:00.128920+0000","last_fullsized":"2023-09-30T01:56:00.128920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:29.888440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157373+0000","last_change":"2023-09-30T01:56:00.152652+0000","last_active":"2023-09-30T01:56:00.157373+0000","last_peered":"2023-09-30T01:56:00.157373+0000","last_clean":"2023-09-30T01:56:00.157373+0000","last_became_active":"2023-09-30T01:56:00.152301+0000","last_became_peered":"2023-09-30T01:56:00.152301+0000","last_unstale":"2023-09-30T01:56:00.157373+0000","last_undegraded":"2023-09-30T01:56:00.157373+0000","last_fullsized":"2023-09-30T01:56:00.157373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:37.790754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.122972+0000","last_change":"2023-09-30T01:55:59.768001+0000","last_active":"2023-09-30T01:56:00.122972+0000","last_peered":"2023-09-30T01:56:00.122972+0000","last_clean":"2023-09-30T01:56:00.122972+0000","last_became_active":"2023-09-30T01:55:59.767723+0000","last_became_peered":"2023-09-30T01:55:59.767723+0000","last_unstale":"2023-09-30T01:56:00.122972+0000","last_undegraded":"2023-09-30T01:56:00.122972+0000","last_fullsized":"2023-09-30T01:56:00.122972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:08:09.194250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129835+0000","last_change":"2023-09-30T01:55:55.597415+0000","last_active":"2023-09-30T01:56:00.129835+0000","last_peered":"2023-09-30T01:56:00.129835+0000","last_clean":"2023-09-30T01:56:00.129835+0000","last_became_active":"2023-09-30T01:55:55.596836+0000","last_became_peered":"2023-09-30T01:55:55.596836+0000","last_unstale":"2023-09-30T01:56:00.129835+0000","last_undegraded":"2023-09-30T01:56:00.129835+0000","last_fullsized":"2023-09-30T01:56:00.129835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:29.888440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.153282+0000","last_change":"2023-09-30T01:56:00.147047+0000","last_active":"2023-09-30T01:56:00.153282+0000","last_peered":"2023-09-30T01:56:00.153282+0000","last_clean":"2023-09-30T01:56:00.153282+0000","last_became_active":"2023-09-30T01:56:00.146771+0000","last_became_peered":"2023-09-30T01:56:00.146771+0000","last_unstale":"2023-09-30T01:56:00.153282+0000","last_undegraded":"2023-09-30T01:56:00.153282+0000","last_fullsized":"2023-09-30T01:56:00.153282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:34:19.920224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.154263+0000","last_change":"2023-09-30T01:55:59.786446+0000","last_active":"2023-09-30T01:56:00.154263+0000","last_peered":"2023-09-30T01:56:00.154263+0000","last_clean":"2023-09-30T01:56:00.154263+0000","last_became_active":"2023-09-30T01:55:59.786162+0000","last_became_peered":"2023-09-30T01:55:59.786162+0000","last_unstale":"2023-09-30T01:56:00.154263+0000","last_undegraded":"2023-09-30T01:56:00.154263+0000","last_fullsized":"2023-09-30T01:56:00.154263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:19.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.123255+0000","last_change":"2023-09-30T01:55:55.597920+0000","last_active":"2023-09-30T01:56:00.123255+0000","last_peered":"2023-09-30T01:56:00.123255+0000","last_clean":"2023-09-30T01:56:00.123255+0000","last_became_active":"2023-09-30T01:55:55.597433+0000","last_became_peered":"2023-09-30T01:55:55.597433+0000","last_unstale":"2023-09-30T01:56:00.123255+0000","last_undegraded":"2023-09-30T01:56:00.123255+0000","last_fullsized":"2023-09-30T01:56:00.123255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:11:56.914296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157594+0000","last_change":"2023-09-30T01:56:00.154867+0000","last_active":"2023-09-30T01:56:00.157594+0000","last_peered":"2023-09-30T01:56:00.157594+0000","last_clean":"2023-09-30T01:56:00.157594+0000","last_became_active":"2023-09-30T01:56:00.154091+0000","last_became_peered":"2023-09-30T01:56:00.154091+0000","last_unstale":"2023-09-30T01:56:00.157594+0000","last_undegraded":"2023-09-30T01:56:00.157594+0000","last_fullsized":"2023-09-30T01:56:00.157594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:10:11.219000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.123177+0000","last_change":"2023-09-30T01:55:59.774863+0000","last_active":"2023-09-30T01:56:00.123177+0000","last_peered":"2023-09-30T01:56:00.123177+0000","last_clean":"2023-09-30T01:56:00.123177+0000","last_became_active":"2023-09-30T01:55:59.774177+0000","last_became_peered":"2023-09-30T01:55:59.774177+0000","last_unstale":"2023-09-30T01:56:00.123177+0000","last_undegraded":"2023-09-30T01:56:00.123177+0000","last_fullsized":"2023-09-30T01:56:00.123177+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:41:38.413142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129713+0000","last_change":"2023-09-30T01:55:55.599569+0000","last_active":"2023-09-30T01:56:00.129713+0000","last_peered":"2023-09-30T01:56:00.129713+0000","last_clean":"2023-09-30T01:56:00.129713+0000","last_became_active":"2023-09-30T01:55:55.599037+0000","last_became_peered":"2023-09-30T01:55:55.599037+0000","last_unstale":"2023-09-30T01:56:00.129713+0000","last_undegraded":"2023-09-30T01:56:00.129713+0000","last_fullsized":"2023-09-30T01:56:00.129713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:03:37.621500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.134188+0000","last_change":"2023-09-30T01:56:00.126614+0000","last_active":"2023-09-30T01:56:00.134188+0000","last_peered":"2023-09-30T01:56:00.134188+0000","last_clean":"2023-09-30T01:56:00.134188+0000","last_became_active":"2023-09-30T01:56:00.126138+0000","last_became_peered":"2023-09-30T01:56:00.126138+0000","last_unstale":"2023-09-30T01:56:00.134188+0000","last_undegraded":"2023-09-30T01:56:00.134188+0000","last_fullsized":"2023-09-30T01:56:00.134188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:55.327377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.135607+0000","last_change":"2023-09-30T01:56:00.126588+0000","last_active":"2023-09-30T01:56:00.135607+0000","last_peered":"2023-09-30T01:56:00.135607+0000","last_clean":"2023-09-30T01:56:00.135607+0000","last_became_active":"2023-09-30T01:56:00.126004+0000","last_became_peered":"2023-09-30T01:56:00.126004+0000","last_unstale":"2023-09-30T01:56:00.135607+0000","last_undegraded":"2023-09-30T01:56:00.135607+0000","last_fullsized":"2023-09-30T01:56:00.135607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:41:39.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.149154+0000","last_change":"2023-09-30T01:55:59.772026+0000","last_active":"2023-09-30T01:56:00.149154+0000","last_peered":"2023-09-30T01:56:00.149154+0000","last_clean":"2023-09-30T01:56:00.149154+0000","last_became_active":"2023-09-30T01:55:59.771159+0000","last_became_peered":"2023-09-30T01:55:59.771159+0000","last_unstale":"2023-09-30T01:56:00.149154+0000","last_undegraded":"2023-09-30T01:56:00.149154+0000","last_fullsized":"2023-09-30T01:56:00.149154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:06:00.627501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155934+0000","last_change":"2023-09-30T01:56:00.152010+0000","last_active":"2023-09-30T01:56:00.155934+0000","last_peered":"2023-09-30T01:56:00.155934+0000","last_clean":"2023-09-30T01:56:00.155934+0000","last_became_active":"2023-09-30T01:56:00.150656+0000","last_became_peered":"2023-09-30T01:56:00.150656+0000","last_unstale":"2023-09-30T01:56:00.155934+0000","last_undegraded":"2023-09-30T01:56:00.155934+0000","last_fullsized":"2023-09-30T01:56:00.155934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:32:22.927822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.141536+0000","last_change":"2023-09-30T01:55:59.780797+0000","last_active":"2023-09-30T01:56:00.141536+0000","last_peered":"2023-09-30T01:56:00.141536+0000","last_clean":"2023-09-30T01:56:00.141536+0000","last_became_active":"2023-09-30T01:55:59.780499+0000","last_became_peered":"2023-09-30T01:55:59.780499+0000","last_unstale":"2023-09-30T01:56:00.141536+0000","last_undegraded":"2023-09-30T01:56:00.141536+0000","last_fullsized":"2023-09-30T01:56:00.141536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:03:41.802753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.128419+0000","last_change":"2023-09-30T01:55:59.781249+0000","last_active":"2023-09-30T01:56:00.128419+0000","last_peered":"2023-09-30T01:56:00.128419+0000","last_clean":"2023-09-30T01:56:00.128419+0000","last_became_active":"2023-09-30T01:55:59.780891+0000","last_became_peered":"2023-09-30T01:55:59.780891+0000","last_unstale":"2023-09-30T01:56:00.128419+0000","last_undegraded":"2023-09-30T01:56:00.128419+0000","last_fullsized":"2023-09-30T01:56:00.128419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:40:23.099697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148788+0000","last_change":"2023-09-30T01:56:00.143575+0000","last_active":"2023-09-30T01:56:00.148788+0000","last_peered":"2023-09-30T01:56:00.148788+0000","last_clean":"2023-09-30T01:56:00.148788+0000","last_became_active":"2023-09-30T01:56:00.143091+0000","last_became_peered":"2023-09-30T01:56:00.143091+0000","last_unstale":"2023-09-30T01:56:00.148788+0000","last_undegraded":"2023-09-30T01:56:00.148788+0000","last_fullsized":"2023-09-30T01:56:00.148788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:42.194028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.131397+0000","last_change":"2023-09-30T01:55:59.774448+0000","last_active":"2023-09-30T01:56:00.131397+0000","last_peered":"2023-09-30T01:56:00.131397+0000","last_clean":"2023-09-30T01:56:00.131397+0000","last_became_active":"2023-09-30T01:55:59.774120+0000","last_became_peered":"2023-09-30T01:55:59.774120+0000","last_unstale":"2023-09-30T01:56:00.131397+0000","last_undegraded":"2023-09-30T01:56:00.131397+0000","last_fullsized":"2023-09-30T01:56:00.131397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:26:30.591338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157610+0000","last_change":"2023-09-30T01:56:00.154894+0000","last_active":"2023-09-30T01:56:00.157610+0000","last_peered":"2023-09-30T01:56:00.157610+0000","last_clean":"2023-09-30T01:56:00.157610+0000","last_became_active":"2023-09-30T01:56:00.154551+0000","last_became_peered":"2023-09-30T01:56:00.154551+0000","last_unstale":"2023-09-30T01:56:00.157610+0000","last_undegraded":"2023-09-30T01:56:00.157610+0000","last_fullsized":"2023-09-30T01:56:00.157610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:31.820081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145272+0000","last_change":"2023-09-30T01:56:00.143924+0000","last_active":"2023-09-30T01:56:00.145272+0000","last_peered":"2023-09-30T01:56:00.145272+0000","last_clean":"2023-09-30T01:56:00.145272+0000","last_became_active":"2023-09-30T01:56:00.143739+0000","last_became_peered":"2023-09-30T01:56:00.143739+0000","last_unstale":"2023-09-30T01:56:00.145272+0000","last_undegraded":"2023-09-30T01:56:00.145272+0000","last_fullsized":"2023-09-30T01:56:00.145272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:16:47.636345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129425+0000","last_change":"2023-09-30T01:55:59.784068+0000","last_active":"2023-09-30T01:56:00.129425+0000","last_peered":"2023-09-30T01:56:00.129425+0000","last_clean":"2023-09-30T01:56:00.129425+0000","last_became_active":"2023-09-30T01:55:59.783547+0000","last_became_peered":"2023-09-30T01:55:59.783547+0000","last_unstale":"2023-09-30T01:56:00.129425+0000","last_undegraded":"2023-09-30T01:56:00.129425+0000","last_fullsized":"2023-09-30T01:56:00.129425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:50:39.919553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155902+0000","last_change":"2023-09-30T01:56:00.151969+0000","last_active":"2023-09-30T01:56:00.155902+0000","last_peered":"2023-09-30T01:56:00.155902+0000","last_clean":"2023-09-30T01:56:00.155902+0000","last_became_active":"2023-09-30T01:56:00.150744+0000","last_became_peered":"2023-09-30T01:56:00.150744+0000","last_unstale":"2023-09-30T01:56:00.155902+0000","last_undegraded":"2023-09-30T01:56:00.155902+0000","last_fullsized":"2023-09-30T01:56:00.155902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:02:54.801532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.121874+0000","last_change":"2023-09-30T01:55:59.783093+0000","last_active":"2023-09-30T01:56:00.121874+0000","last_peered":"2023-09-30T01:56:00.121874+0000","last_clean":"2023-09-30T01:56:00.121874+0000","last_became_active":"2023-09-30T01:55:59.782532+0000","last_became_peered":"2023-09-30T01:55:59.782532+0000","last_unstale":"2023-09-30T01:56:00.121874+0000","last_undegraded":"2023-09-30T01:56:00.121874+0000","last_fullsized":"2023-09-30T01:56:00.121874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:22.053979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157524+0000","last_change":"2023-09-30T01:56:00.154425+0000","last_active":"2023-09-30T01:56:00.157524+0000","last_peered":"2023-09-30T01:56:00.157524+0000","last_clean":"2023-09-30T01:56:00.157524+0000","last_became_active":"2023-09-30T01:56:00.153913+0000","last_became_peered":"2023-09-30T01:56:00.153913+0000","last_unstale":"2023-09-30T01:56:00.157524+0000","last_undegraded":"2023-09-30T01:56:00.157524+0000","last_fullsized":"2023-09-30T01:56:00.157524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:32:22.927822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.147919+0000","last_change":"2023-09-30T01:55:59.781339+0000","last_active":"2023-09-30T01:56:00.147919+0000","last_peered":"2023-09-30T01:56:00.147919+0000","last_clean":"2023-09-30T01:56:00.147919+0000","last_became_active":"2023-09-30T01:55:59.780916+0000","last_became_peered":"2023-09-30T01:55:59.780916+0000","last_unstale":"2023-09-30T01:56:00.147919+0000","last_undegraded":"2023-09-30T01:56:00.147919+0000","last_fullsized":"2023-09-30T01:56:00.147919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:16:33.196455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145239+0000","last_change":"2023-09-30T01:56:00.135640+0000","last_active":"2023-09-30T01:56:00.145239+0000","last_peered":"2023-09-30T01:56:00.145239+0000","last_clean":"2023-09-30T01:56:00.145239+0000","last_became_active":"2023-09-30T01:56:00.135362+0000","last_became_peered":"2023-09-30T01:56:00.135362+0000","last_unstale":"2023-09-30T01:56:00.145239+0000","last_undegraded":"2023-09-30T01:56:00.145239+0000","last_fullsized":"2023-09-30T01:56:00.145239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:08:10.207253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.144433+0000","last_change":"2023-09-30T01:55:59.783858+0000","last_active":"2023-09-30T01:56:00.144433+0000","last_peered":"2023-09-30T01:56:00.144433+0000","last_clean":"2023-09-30T01:56:00.144433+0000","last_became_active":"2023-09-30T01:55:59.782368+0000","last_became_peered":"2023-09-30T01:55:59.782368+0000","last_unstale":"2023-09-30T01:56:00.144433+0000","last_undegraded":"2023-09-30T01:56:00.144433+0000","last_fullsized":"2023-09-30T01:56:00.144433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:08:09.194250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.146297+0000","last_change":"2023-09-30T01:56:00.141317+0000","last_active":"2023-09-30T01:56:00.146297+0000","last_peered":"2023-09-30T01:56:00.146297+0000","last_clean":"2023-09-30T01:56:00.146297+0000","last_became_active":"2023-09-30T01:56:00.141087+0000","last_became_peered":"2023-09-30T01:56:00.141087+0000","last_unstale":"2023-09-30T01:56:00.146297+0000","last_undegraded":"2023-09-30T01:56:00.146297+0000","last_fullsized":"2023-09-30T01:56:00.146297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:24:26.401425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.147345+0000","last_change":"2023-09-30T01:55:59.782826+0000","last_active":"2023-09-30T01:56:00.147345+0000","last_peered":"2023-09-30T01:56:00.147345+0000","last_clean":"2023-09-30T01:56:00.147345+0000","last_became_active":"2023-09-30T01:55:59.782495+0000","last_became_peered":"2023-09-30T01:55:59.782495+0000","last_unstale":"2023-09-30T01:56:00.147345+0000","last_undegraded":"2023-09-30T01:56:00.147345+0000","last_fullsized":"2023-09-30T01:56:00.147345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:56:41.268990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143147+0000","last_change":"2023-09-30T01:56:00.138415+0000","last_active":"2023-09-30T01:56:00.143147+0000","last_peered":"2023-09-30T01:56:00.143147+0000","last_clean":"2023-09-30T01:56:00.143147+0000","last_became_active":"2023-09-30T01:56:00.137941+0000","last_became_peered":"2023-09-30T01:56:00.137941+0000","last_unstale":"2023-09-30T01:56:00.143147+0000","last_undegraded":"2023-09-30T01:56:00.143147+0000","last_fullsized":"2023-09-30T01:56:00.143147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:08:55.103499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142155+0000","last_change":"2023-09-30T01:55:59.776546+0000","last_active":"2023-09-30T01:56:00.142155+0000","last_peered":"2023-09-30T01:56:00.142155+0000","last_clean":"2023-09-30T01:56:00.142155+0000","last_became_active":"2023-09-30T01:55:59.776242+0000","last_became_peered":"2023-09-30T01:55:59.776242+0000","last_unstale":"2023-09-30T01:56:00.142155+0000","last_undegraded":"2023-09-30T01:56:00.142155+0000","last_fullsized":"2023-09-30T01:56:00.142155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:24:25.388422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148797+0000","last_change":"2023-09-30T01:56:00.143686+0000","last_active":"2023-09-30T01:56:00.148797+0000","last_peered":"2023-09-30T01:56:00.148797+0000","last_clean":"2023-09-30T01:56:00.148797+0000","last_became_active":"2023-09-30T01:56:00.143388+0000","last_became_peered":"2023-09-30T01:56:00.143388+0000","last_unstale":"2023-09-30T01:56:00.148797+0000","last_undegraded":"2023-09-30T01:56:00.148797+0000","last_fullsized":"2023-09-30T01:56:00.148797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:55:57.453826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145902+0000","last_change":"2023-09-30T01:55:59.786229+0000","last_active":"2023-09-30T01:56:00.145902+0000","last_peered":"2023-09-30T01:56:00.145902+0000","last_clean":"2023-09-30T01:56:00.145902+0000","last_became_active":"2023-09-30T01:55:59.785944+0000","last_became_peered":"2023-09-30T01:55:59.785944+0000","last_unstale":"2023-09-30T01:56:00.145902+0000","last_undegraded":"2023-09-30T01:56:00.145902+0000","last_fullsized":"2023-09-30T01:56:00.145902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:23:52.565054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150643+0000","last_change":"2023-09-30T01:56:00.148962+0000","last_active":"2023-09-30T01:56:00.150643+0000","last_peered":"2023-09-30T01:56:00.150643+0000","last_clean":"2023-09-30T01:56:00.150643+0000","last_became_active":"2023-09-30T01:56:00.147919+0000","last_became_peered":"2023-09-30T01:56:00.147919+0000","last_unstale":"2023-09-30T01:56:00.150643+0000","last_undegraded":"2023-09-30T01:56:00.150643+0000","last_fullsized":"2023-09-30T01:56:00.150643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:29:29.479636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145517+0000","last_change":"2023-09-30T01:55:59.769801+0000","last_active":"2023-09-30T01:56:00.145517+0000","last_peered":"2023-09-30T01:56:00.145517+0000","last_clean":"2023-09-30T01:56:00.145517+0000","last_became_active":"2023-09-30T01:55:59.769503+0000","last_became_peered":"2023-09-30T01:55:59.769503+0000","last_unstale":"2023-09-30T01:56:00.145517+0000","last_undegraded":"2023-09-30T01:56:00.145517+0000","last_fullsized":"2023-09-30T01:56:00.145517+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:45:38.723185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705670,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8128,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363712,"statfs":{"total":96636764160,"available":96628441088,"internally_reserved":0,"allocated":188416,"data_stored":60567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":786432,"data_stored":652110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2749999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.21}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9152,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362688,"statfs":{"total":96636764160,"available":96627392512,"internally_reserved":0,"allocated":778240,"data_stored":651317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0249999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12232,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359608,"statfs":{"total":96636764160,"available":96624238592,"internally_reserved":0,"allocated":196608,"data_stored":61224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T01:56:07.840 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-09-30T01:56:07.841 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-09-30T01:56:07.841 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-09-30T01:56:07.841 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-09-30T01:56:07.841 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-09-30T01:56:07.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.947+0000 7f7dfa273700 1 Processor -- start 2023-09-30T01:56:07.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.947+0000 7f7dfa273700 1 -- start start 2023-09-30T01:56:07.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.947+0000 7f7dfa273700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f7df406af90 0x7f7df413d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:07.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.947+0000 7f7dfa273700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7df413d5a0 0x7f7df41473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:07.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.947+0000 7f7dfa273700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7df40a1880 con 0x7f7df40a4bc0 2023-09-30T01:56:07.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.947+0000 7f7dfa273700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df40a4f90 con 0x7f7df413d5a0 2023-09-30T01:56:07.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.947+0000 7f7dfa273700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7df406b360 con 0x7f7df406af90 2023-09-30T01:56:07.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.947+0000 7f7df9a72700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7df413d5a0 0x7f7df41473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:07.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.947+0000 7f7df9271700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7df40a4bc0 0x7f7df406c360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53134/0 (socket says 172.21.15.55:53134) 2023-09-30T01:56:07.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.947+0000 7f7df9a72700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7df413d5a0 0x7f7df41473c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39890/0 (socket says 172.21.15.55:39890) 2023-09-30T01:56:07.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.947+0000 7f7df9271700 1 -- 172.21.15.55:0/1442271507 learned_addr learned my addr 172.21.15.55:0/1442271507 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:07.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.947+0000 7f7df8a70700 1 --2- 172.21.15.55:0/1442271507 >> v2:172.21.15.133:3300/0 conn(0x7f7df406af90 0x7f7df413d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7df9a72700 1 -- 172.21.15.55:0/1442271507 >> v2:172.21.15.133:3300/0 conn(0x7f7df406af90 msgr2=0x7f7df413d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7df9a72700 1 --2- 172.21.15.55:0/1442271507 >> v2:172.21.15.133:3300/0 conn(0x7f7df406af90 0x7f7df413d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7df9a72700 1 -- 172.21.15.55:0/1442271507 >> v1:172.21.15.55:6789/0 conn(0x7f7df40a4bc0 legacy=0x7f7df406c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7df9a72700 1 -- 172.21.15.55:0/1442271507 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df40a1ab0 con 0x7f7df413d5a0 2023-09-30T01:56:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7de7fff700 1 -- 172.21.15.55:0/1442271507 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1499849276 0 0) 0x7f7df40a1880 con 0x7f7df40a4bc0 2023-09-30T01:56:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7df9a72700 1 --2- 172.21.15.55:0/1442271507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7df413d5a0 0x7f7df41473c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7df40a1ca0 tx=0x7f7dec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb87e07f1d2ba571 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7de7fff700 1 -- 172.21.15.55:0/1442271507 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec00bc00 con 0x7f7df413d5a0 2023-09-30T01:56:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7de7fff700 1 -- 172.21.15.55:0/1442271507 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec00bd60 con 0x7f7df413d5a0 2023-09-30T01:56:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7de7fff700 1 -- 172.21.15.55:0/1442271507 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec0116b0 con 0x7f7df413d5a0 2023-09-30T01:56:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7dfa273700 1 -- 172.21.15.55:0/1442271507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7df413d5a0 msgr2=0x7f7df41473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:07.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7dfa273700 1 --2- 172.21.15.55:0/1442271507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7df413d5a0 0x7f7df41473c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f7df40a1ca0 tx=0x7f7dec009780 comp rx=0 tx=0).stop 2023-09-30T01:56:07.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7dfa273700 1 -- 172.21.15.55:0/1442271507 shutdown_connections 2023-09-30T01:56:07.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7dfa273700 1 --2- 172.21.15.55:0/1442271507 >> v2:172.21.15.133:3300/0 conn(0x7f7df406af90 0x7f7df413d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:07.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7dfa273700 1 --2- 172.21.15.55:0/1442271507 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7df413d5a0 0x7f7df41473c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:07.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7dfa273700 1 -- 172.21.15.55:0/1442271507 >> 172.21.15.55:0/1442271507 conn(0x7f7df40b23d0 msgr2=0x7f7df40b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:07.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7dfa273700 1 -- 172.21.15.55:0/1442271507 shutdown_connections 2023-09-30T01:56:07.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7dfa273700 1 -- 172.21.15.55:0/1442271507 wait complete. 2023-09-30T01:56:07.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7dfa273700 1 Processor -- start 2023-09-30T01:56:07.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.951+0000 7f7dfa273700 1 -- start start 2023-09-30T01:56:07.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7dfa273700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7df406af90 0x7f7df4099740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:07.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7dfa273700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df40a4bc0 0x7f7df414e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:07.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7dfa273700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7df413d5a0 0x7f7df4097fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:07.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7dfa273700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df4098a60 con 0x7f7df413d5a0 2023-09-30T01:56:07.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7dfa273700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7df414f050 con 0x7f7df40a4bc0 2023-09-30T01:56:07.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7dfa273700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7df414f310 con 0x7f7df406af90 2023-09-30T01:56:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7df9a72700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7df413d5a0 0x7f7df4097fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7df9271700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7df406af90 0x7f7df4099740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7df9a72700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7df413d5a0 0x7f7df4097fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39906/0 (socket says 172.21.15.55:39906) 2023-09-30T01:56:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7df9a72700 1 -- 172.21.15.55:0/2064643426 learned_addr learned my addr 172.21.15.55:0/2064643426 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7df8a70700 1 --2- 172.21.15.55:0/2064643426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df40a4bc0 0x7f7df414e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7df9a72700 1 -- 172.21.15.55:0/2064643426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7df406af90 msgr2=0x7f7df4099740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7df9a72700 1 --2- 172.21.15.55:0/2064643426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7df406af90 0x7f7df4099740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7df9a72700 1 -- 172.21.15.55:0/2064643426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df40a4bc0 msgr2=0x7f7df414e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7df9a72700 1 --2- 172.21.15.55:0/2064643426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df40a4bc0 0x7f7df414e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:07.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7df9a72700 1 -- 172.21.15.55:0/2064643426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dec009a20 con 0x7f7df413d5a0 2023-09-30T01:56:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7df9a72700 1 --2- 172.21.15.55:0/2064643426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7df413d5a0 0x7f7df4097fc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009fd0 tx=0x7f7dec01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7de57fa700 1 -- 172.21.15.55:0/2064643426 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec00bed0 con 0x7f7df413d5a0 2023-09-30T01:56:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7de57fa700 1 -- 172.21.15.55:0/2064643426 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec01d070 con 0x7f7df413d5a0 2023-09-30T01:56:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7dfa273700 1 -- 172.21.15.55:0/2064643426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7df4099160 con 0x7f7df413d5a0 2023-09-30T01:56:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7de57fa700 1 -- 172.21.15.55:0/2064643426 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec019e40 con 0x7f7df413d5a0 2023-09-30T01:56:07.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7dfa273700 1 -- 172.21.15.55:0/2064643426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7df4095cf0 con 0x7f7df413d5a0 2023-09-30T01:56:07.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.955+0000 7f7dfa273700 1 -- 172.21.15.55:0/2064643426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7df4099440 con 0x7f7df413d5a0 2023-09-30T01:56:07.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.959+0000 7f7de57fa700 1 -- 172.21.15.55:0/2064643426 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f7dec003020 con 0x7f7df413d5a0 2023-09-30T01:56:07.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.959+0000 7f7de57fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:07.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.959+0000 7f7de57fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:07.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.959+0000 7f7de57fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:07.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.959+0000 7f7de57fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:07.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.959+0000 7f7de57fa700 1 --2- 172.21.15.55:0/2064643426 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7dd808e830 0x7f7dd8090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:07.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.959+0000 7f7de57fa700 1 -- 172.21.15.55:0/2064643426 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f7dec0b9280 con 0x7f7df413d5a0 2023-09-30T01:56:07.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.959+0000 7f7df9271700 1 --2- 172.21.15.55:0/2064643426 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7dd808e830 0x7f7dd8090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:07.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.959+0000 7f7df9271700 1 --2- 172.21.15.55:0/2064643426 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7dd808e830 0x7f7dd8090ce0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7df0007fd0 tx=0x7f7df0007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:07.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:07.967+0000 7f7de57fa700 1 -- 172.21.15.55:0/2064643426 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7dec089d40 con 0x7f7df413d5a0 2023-09-30T01:56:08.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.167+0000 7f7dfa273700 1 -- 172.21.15.55:0/2064643426 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f7df4064440 con 0x7f7df413d5a0 2023-09-30T01:56:08.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.179+0000 7f7de57fa700 1 -- 172.21.15.55:0/2064643426 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+230609 (secure 0 0 0) 0x7f7dec0032d0 con 0x7f7df413d5a0 2023-09-30T01:56:08.186 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.183+0000 7f7dfa273700 10 mgrc shutdown 2023-09-30T01:56:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.183+0000 7f7dfa273700 1 -- 172.21.15.55:0/2064643426 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7dd808e830 msgr2=0x7f7dd8090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.188 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.183+0000 7f7dfa273700 1 --2- 172.21.15.55:0/2064643426 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7dd808e830 0x7f7dd8090ce0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7df0007fd0 tx=0x7f7df0007d30 comp rx=0 tx=0).stop 2023-09-30T01:56:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.183+0000 7f7dfa273700 1 -- 172.21.15.55:0/2064643426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7df413d5a0 msgr2=0x7f7df4097fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.183+0000 7f7dfa273700 1 --2- 172.21.15.55:0/2064643426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7df413d5a0 0x7f7df4097fc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7dec009fd0 tx=0x7f7dec01a000 comp rx=0 tx=0).stop 2023-09-30T01:56:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.183+0000 7f7dfa273700 1 -- 172.21.15.55:0/2064643426 shutdown_connections 2023-09-30T01:56:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.183+0000 7f7dfa273700 1 --2- 172.21.15.55:0/2064643426 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7df413d5a0 0x7f7df4097fc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.183+0000 7f7dfa273700 1 --2- 172.21.15.55:0/2064643426 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7df40a4bc0 0x7f7df414e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.183+0000 7f7dfa273700 1 --2- 172.21.15.55:0/2064643426 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7dd808e830 0x7f7dd8090ce0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.189 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.183+0000 7f7dfa273700 1 --2- 172.21.15.55:0/2064643426 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7df406af90 0x7f7df4099740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.183+0000 7f7dfa273700 1 -- 172.21.15.55:0/2064643426 >> 172.21.15.55:0/2064643426 conn(0x7f7df40b23d0 msgr2=0x7f7df406e7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:08.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.183+0000 7f7dfa273700 1 -- 172.21.15.55:0/2064643426 shutdown_connections 2023-09-30T01:56:08.190 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.183+0000 7f7dfa273700 1 -- 172.21.15.55:0/2064643426 wait complete. 2023-09-30T01:56:08.202 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":5,"active_gid":4103,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6808","nonce":27538},{"type":"v1","addr":"172.21.15.55:6809","nonce":27538}]},"active_addr":"172.21.15.55:6809/27538","active_change":"2023-09-30T01:55:43.005375+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4106,"name":"y","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":4111,"name":"z","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":false,"error_string":"loading asyncssh library:No module named 'asyncssh'","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":1158471819}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":1836865035}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":2190864606}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.55:0","nonce":900533623}]}]} 2023-09-30T01:56:08.209 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-09-30T01:56:08.210 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-09-30T01:56:08.210 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T01:56:08.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f877b59e700 1 Processor -- start 2023-09-30T01:56:08.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f877b59e700 1 -- start start 2023-09-30T01:56:08.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f877b59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f877c135fe0 0x7f877c06d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f877b59e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f877c06e6c0 0x7f877c06ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f877b59e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f877c06eb00 con 0x7f877c143360 2023-09-30T01:56:08.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f877b59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f877c143f90 con 0x7f877c135fe0 2023-09-30T01:56:08.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f877b59e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c070460 con 0x7f877c06e6c0 2023-09-30T01:56:08.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f877ad9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f877c143360 0x7f877c143760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53144/0 (socket says 172.21.15.55:53144) 2023-09-30T01:56:08.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f877ad9d700 1 -- 172.21.15.55:0/3438625869 learned_addr learned my addr 172.21.15.55:0/3438625869 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:08.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f8779d9b700 1 --2- 172.21.15.55:0/3438625869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f877c06e6c0 0x7f877c06ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f877a59c700 1 --2- 172.21.15.55:0/3438625869 >> v2:172.21.15.133:3300/0 conn(0x7f877c135fe0 0x7f877c06d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f877959a700 1 -- 172.21.15.55:0/3438625869 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482933015 0 0) 0x7f877c06eb00 con 0x7f877c143360 2023-09-30T01:56:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f877959a700 1 -- 172.21.15.55:0/3438625869 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8764003570 con 0x7f877c143360 2023-09-30T01:56:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f8779d9b700 1 -- 172.21.15.55:0/3438625869 >> v2:172.21.15.133:3300/0 conn(0x7f877c135fe0 msgr2=0x7f877c06d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f8779d9b700 1 --2- 172.21.15.55:0/3438625869 >> v2:172.21.15.133:3300/0 conn(0x7f877c135fe0 0x7f877c06d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f8779d9b700 1 -- 172.21.15.55:0/3438625869 >> v1:172.21.15.55:6789/0 conn(0x7f877c143360 legacy=0x7f877c143760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f877959a700 1 -- 172.21.15.55:0/3438625869 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 569589579 0 0) 0x7f8764003570 con 0x7f877c143360 2023-09-30T01:56:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f8779d9b700 1 -- 172.21.15.55:0/3438625869 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f877c1363b0 con 0x7f877c06e6c0 2023-09-30T01:56:08.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.315+0000 7f877a59c700 1 --2- 172.21.15.55:0/3438625869 >> v2:172.21.15.133:3300/0 conn(0x7f877c135fe0 0x7f877c06d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.319+0000 7f8779d9b700 1 --2- 172.21.15.55:0/3438625869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f877c06e6c0 0x7f877c06ff20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87700098e0 tx=0x7f87700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0ce85d22a30dd6f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.319+0000 7f877959a700 1 -- 172.21.15.55:0/3438625869 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f876c001490 con 0x7f877c06e6c0 2023-09-30T01:56:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.319+0000 7f877959a700 1 -- 172.21.15.55:0/3438625869 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8770011420 con 0x7f877c06e6c0 2023-09-30T01:56:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.319+0000 7f877959a700 1 -- 172.21.15.55:0/3438625869 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87700117a0 con 0x7f877c06e6c0 2023-09-30T01:56:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.319+0000 7f877b59e700 1 -- 172.21.15.55:0/3438625869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f877c06e6c0 msgr2=0x7f877c06ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.319+0000 7f877b59e700 1 --2- 172.21.15.55:0/3438625869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f877c06e6c0 0x7f877c06ff20 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f87700098e0 tx=0x7f87700091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.319+0000 7f877b59e700 1 -- 172.21.15.55:0/3438625869 shutdown_connections 2023-09-30T01:56:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.319+0000 7f877b59e700 1 --2- 172.21.15.55:0/3438625869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f877c06e6c0 0x7f877c06ff20 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.319+0000 7f877b59e700 1 --2- 172.21.15.55:0/3438625869 >> v2:172.21.15.133:3300/0 conn(0x7f877c135fe0 0x7f877c06d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.319+0000 7f877b59e700 1 -- 172.21.15.55:0/3438625869 >> 172.21.15.55:0/3438625869 conn(0x7f877c06a7b0 msgr2=0x7f877c0a53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:08.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.319+0000 7f877b59e700 1 -- 172.21.15.55:0/3438625869 shutdown_connections 2023-09-30T01:56:08.325 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.319+0000 7f877b59e700 1 -- 172.21.15.55:0/3438625869 wait complete. 2023-09-30T01:56:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.319+0000 7f877b59e700 1 Processor -- start 2023-09-30T01:56:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.319+0000 7f877b59e700 1 -- start start 2023-09-30T01:56:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f877b59e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f877c06e6c0 0x7f877c148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f877b59e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f877c135fe0 0x7f877c0acc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f877b59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f877c143360 0x7f877c0ad1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f877b59e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c148530 con 0x7f877c135fe0 2023-09-30T01:56:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f877b59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f877c147180 con 0x7f877c143360 2023-09-30T01:56:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f877b59e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f877c0ac770 con 0x7f877c06e6c0 2023-09-30T01:56:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f8779d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f877c135fe0 0x7f877c0acc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f877a59c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f877c06e6c0 0x7f877c148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f8779d9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f877c135fe0 0x7f877c0acc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39910/0 (socket says 172.21.15.55:39910) 2023-09-30T01:56:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f8779d9b700 1 -- 172.21.15.55:0/686853931 learned_addr learned my addr 172.21.15.55:0/686853931 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f877ad9d700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f877c143360 0x7f877c0ad1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f8779d9b700 1 -- 172.21.15.55:0/686853931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f877c06e6c0 msgr2=0x7f877c148e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f8779d9b700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f877c06e6c0 0x7f877c148e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f8779d9b700 1 -- 172.21.15.55:0/686853931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f877c143360 msgr2=0x7f877c0ad1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f8779d9b700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f877c143360 0x7f877c0ad1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f8779d9b700 1 -- 172.21.15.55:0/686853931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8774009a20 con 0x7f877c135fe0 2023-09-30T01:56:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f877a59c700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f877c06e6c0 0x7f877c148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f877ad9d700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f877c143360 0x7f877c0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:56:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f8779d9b700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f877c135fe0 0x7f877c0acc70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8770009ed0 tx=0x7f8770016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f876a7fc700 1 -- 172.21.15.55:0/686853931 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877001cae0 con 0x7f877c135fe0 2023-09-30T01:56:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f876a7fc700 1 -- 172.21.15.55:0/686853931 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f877001cc40 con 0x7f877c135fe0 2023-09-30T01:56:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f877b59e700 1 -- 172.21.15.55:0/686853931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8770009420 con 0x7f877c135fe0 2023-09-30T01:56:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f876a7fc700 1 -- 172.21.15.55:0/686853931 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f877001a450 con 0x7f877c135fe0 2023-09-30T01:56:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f877b59e700 1 -- 172.21.15.55:0/686853931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f877c1493a0 con 0x7f877c135fe0 2023-09-30T01:56:08.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.323+0000 7f877b59e700 1 -- 172.21.15.55:0/686853931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f877c1486a0 con 0x7f877c135fe0 2023-09-30T01:56:08.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.327+0000 7f876a7fc700 1 -- 172.21.15.55:0/686853931 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f877001a840 con 0x7f877c135fe0 2023-09-30T01:56:08.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.327+0000 7f876a7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:08.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.327+0000 7f876a7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:08.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.327+0000 7f876a7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:08.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.327+0000 7f876a7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:08.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.327+0000 7f876a7fc700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f875c08e8b0 0x7f875c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.334 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.327+0000 7f876a7fc700 1 -- 172.21.15.55:0/686853931 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f87700b6280 con 0x7f877c135fe0 2023-09-30T01:56:08.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.327+0000 7f877a59c700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f875c08e8b0 0x7f875c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.331+0000 7f877a59c700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f875c08e8b0 0x7f875c090d60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f877400eae0 tx=0x7f877400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.335 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.331+0000 7f876a7fc700 1 -- 172.21.15.55:0/686853931 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8770086ca0 con 0x7f877c135fe0 2023-09-30T01:56:08.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.491+0000 7f877b59e700 1 -- 172.21.15.55:0/686853931 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f877c148670 con 0x7f877c135fe0 2023-09-30T01:56:08.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.495+0000 7f876a7fc700 1 -- 172.21.15.55:0/686853931 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12194 (secure 0 0 0) 0x7f877008a2c0 con 0x7f877c135fe0 2023-09-30T01:56:08.498 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:08.498 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"fsid":"37496c89-c485-46e5-8550-5722d2abf46a","created":"2023-09-30T01:55:38.697831+0000","modified":"2023-09-30T01:56:01.106295+0000","last_up_change":"2023-09-30T01:55:48.191927+0000","last_in_change":"2023-09-30T01:55:39.813210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T01:55:49.090600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T01:55:54.370944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T01:55:58.474504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T01:55:59.107639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27634},{"type":"v1","addr":"172.21.15.55:6801","nonce":27634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27634},{"type":"v1","addr":"172.21.15.55:6803","nonce":27634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27634},{"type":"v1","addr":"172.21.15.55:6807","nonce":27634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27634},{"type":"v1","addr":"172.21.15.55:6805","nonce":27634}]},"public_addr":"172.21.15.55:6801/27634","cluster_addr":"172.21.15.55:6803/27634","heartbeat_back_addr":"172.21.15.55:6807/27634","heartbeat_front_addr":"172.21.15.55:6805/27634","state":["exists","up"]},{"osd":1,"uuid":"b52b4f6f-00aa-4ef8-b3d4-467475cd0bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":30066},{"type":"v1","addr":"172.21.15.133:6809","nonce":30066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":30066},{"type":"v1","addr":"172.21.15.133:6811","nonce":30066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":30066},{"type":"v1","addr":"172.21.15.133:6815","nonce":30066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":30066},{"type":"v1","addr":"172.21.15.133:6813","nonce":30066}]},"public_addr":"172.21.15.133:6809/30066","cluster_addr":"172.21.15.133:6811/30066","heartbeat_back_addr":"172.21.15.133:6815/30066","heartbeat_front_addr":"172.21.15.133:6813/30066","state":["exists","up"]},{"osd":2,"uuid":"c48b2c87-a33c-47fc-8b84-e64faad378b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":30068},{"type":"v1","addr":"172.21.15.133:6817","nonce":30068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":30068},{"type":"v1","addr":"172.21.15.133:6819","nonce":30068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":30068},{"type":"v1","addr":"172.21.15.133:6823","nonce":30068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":30068},{"type":"v1","addr":"172.21.15.133:6821","nonce":30068}]},"public_addr":"172.21.15.133:6817/30068","cluster_addr":"172.21.15.133:6819/30068","heartbeat_back_addr":"172.21.15.133:6823/30068","heartbeat_front_addr":"172.21.15.133:6821/30068","state":["exists","up"]},{"osd":3,"uuid":"614c2d45-f7b8-42e8-ba09-6e042a2358b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":30067},{"type":"v1","addr":"172.21.15.133:6801","nonce":30067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":30067},{"type":"v1","addr":"172.21.15.133:6803","nonce":30067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":30067},{"type":"v1","addr":"172.21.15.133:6807","nonce":30067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":30067},{"type":"v1","addr":"172.21.15.133:6805","nonce":30067}]},"public_addr":"172.21.15.133:6801/30067","cluster_addr":"172.21.15.133:6803/30067","heartbeat_back_addr":"172.21.15.133:6807/30067","heartbeat_front_addr":"172.21.15.133:6805/30067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.342817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.400384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.363652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.069618+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T01:56:08.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.495+0000 7f877b59e700 10 mgrc shutdown 2023-09-30T01:56:08.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.495+0000 7f877b59e700 1 -- 172.21.15.55:0/686853931 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f875c08e8b0 msgr2=0x7f875c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.495+0000 7f877b59e700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f875c08e8b0 0x7f875c090d60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f877400eae0 tx=0x7f877400b040 comp rx=0 tx=0).stop 2023-09-30T01:56:08.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.495+0000 7f877b59e700 1 -- 172.21.15.55:0/686853931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f877c135fe0 msgr2=0x7f877c0acc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.495+0000 7f877b59e700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f877c135fe0 0x7f877c0acc70 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8770009ed0 tx=0x7f8770016000 comp rx=0 tx=0).stop 2023-09-30T01:56:08.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.495+0000 7f877b59e700 1 -- 172.21.15.55:0/686853931 shutdown_connections 2023-09-30T01:56:08.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.495+0000 7f877b59e700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f877c143360 0x7f877c0ad1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.495+0000 7f877b59e700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f877c135fe0 0x7f877c0acc70 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.495+0000 7f877b59e700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f875c08e8b0 0x7f875c090d60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.495+0000 7f877b59e700 1 --2- 172.21.15.55:0/686853931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f877c06e6c0 0x7f877c148e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.495+0000 7f877b59e700 1 -- 172.21.15.55:0/686853931 >> 172.21.15.55:0/686853931 conn(0x7f877c06a7b0 msgr2=0x7f877c0a53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:08.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.495+0000 7f877b59e700 1 -- 172.21.15.55:0/686853931 shutdown_connections 2023-09-30T01:56:08.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.495+0000 7f877b59e700 1 -- 172.21.15.55:0/686853931 wait complete. 2023-09-30T01:56:08.513 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-09-30T01:56:08.513 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T01:56:08.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f3527d00700 1 Processor -- start 2023-09-30T01:56:08.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f3527d00700 1 -- start start 2023-09-30T01:56:08.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f3527d00700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f352013ab10 0x7f352006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f3527d00700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3520147ac0 0x7f3520147ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f3527d00700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f352006daf0 con 0x7f35200b3060 2023-09-30T01:56:08.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f3527d00700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35201489d0 con 0x7f3520147ac0 2023-09-30T01:56:08.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f3527d00700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f352006d910 con 0x7f352013ab10 2023-09-30T01:56:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f352629d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3520147ac0 0x7f3520147ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f352529b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f352013ab10 0x7f352006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f352629d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3520147ac0 0x7f3520147ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39912/0 (socket says 172.21.15.55:39912) 2023-09-30T01:56:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f352629d700 1 -- 172.21.15.55:0/907967989 learned_addr learned my addr 172.21.15.55:0/907967989 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f352629d700 1 -- 172.21.15.55:0/907967989 >> v2:172.21.15.133:3300/0 conn(0x7f352013ab10 msgr2=0x7f352006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f352629d700 1 --2- 172.21.15.55:0/907967989 >> v2:172.21.15.133:3300/0 conn(0x7f352013ab10 0x7f352006d3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f352629d700 1 -- 172.21.15.55:0/907967989 >> v1:172.21.15.133:6789/0 conn(0x7f35200b3060 legacy=0x7f352013a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f352629d700 1 -- 172.21.15.55:0/907967989 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35200b3430 con 0x7f3520147ac0 2023-09-30T01:56:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f352629d700 1 --2- 172.21.15.55:0/907967989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3520147ac0 0x7f3520147ef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3520063b60 tx=0x7f3510009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e31c4c5d214564fa server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f3524a9a700 1 -- 172.21.15.55:0/907967989 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f351000e070 con 0x7f3520147ac0 2023-09-30T01:56:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f3524a9a700 1 -- 172.21.15.55:0/907967989 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f351000ba20 con 0x7f3520147ac0 2023-09-30T01:56:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.611+0000 7f3524a9a700 1 -- 172.21.15.55:0/907967989 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35100092e0 con 0x7f3520147ac0 2023-09-30T01:56:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.615+0000 7f3527d00700 1 -- 172.21.15.55:0/907967989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3520147ac0 msgr2=0x7f3520147ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.615+0000 7f3527d00700 1 --2- 172.21.15.55:0/907967989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3520147ac0 0x7f3520147ef0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3520063b60 tx=0x7f3510009840 comp rx=0 tx=0).stop 2023-09-30T01:56:08.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.615+0000 7f3527d00700 1 -- 172.21.15.55:0/907967989 shutdown_connections 2023-09-30T01:56:08.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.615+0000 7f3527d00700 1 --2- 172.21.15.55:0/907967989 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3520147ac0 0x7f3520147ef0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.615+0000 7f3527d00700 1 --2- 172.21.15.55:0/907967989 >> v2:172.21.15.133:3300/0 conn(0x7f352013ab10 0x7f352006d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.615+0000 7f3527d00700 1 -- 172.21.15.55:0/907967989 >> 172.21.15.55:0/907967989 conn(0x7f3520068b00 msgr2=0x7f35200b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.615+0000 7f3527d00700 1 -- 172.21.15.55:0/907967989 shutdown_connections 2023-09-30T01:56:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.615+0000 7f3527d00700 1 -- 172.21.15.55:0/907967989 wait complete. 2023-09-30T01:56:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.615+0000 7f3527d00700 1 Processor -- start 2023-09-30T01:56:08.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.615+0000 7f3527d00700 1 -- start start 2023-09-30T01:56:08.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.615+0000 7f3527d00700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35200b3060 0x7f35200a9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.615+0000 7f3527d00700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3520147ac0 0x7f3520149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f3527d00700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35201356c0 0x7f3520135b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f3527d00700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35200a8d40 con 0x7f35201356c0 2023-09-30T01:56:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f3527d00700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35200a9020 con 0x7f3520147ac0 2023-09-30T01:56:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f3527d00700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3520136240 con 0x7f35200b3060 2023-09-30T01:56:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f3525a9c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35200b3060 0x7f35200a9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f3525a9c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35200b3060 0x7f35200a9520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43794/0 (socket says 172.21.15.55:43794) 2023-09-30T01:56:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f3525a9c700 1 -- 172.21.15.55:0/2872236729 learned_addr learned my addr 172.21.15.55:0/2872236729 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f352629d700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35201356c0 0x7f3520135b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f352529b700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3520147ac0 0x7f3520149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f352629d700 1 -- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35200b3060 msgr2=0x7f35200a9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f352629d700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35200b3060 0x7f35200a9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f352629d700 1 -- 172.21.15.55:0/2872236729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3520147ac0 msgr2=0x7f3520149de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f352629d700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3520147ac0 0x7f3520149de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f352629d700 1 -- 172.21.15.55:0/2872236729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3510009ae0 con 0x7f35201356c0 2023-09-30T01:56:08.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f3525a9c700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35200b3060 0x7f35200a9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:08.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f352629d700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35201356c0 0x7f3520135b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3510015000 tx=0x7f3510018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f3515ffb700 1 -- 172.21.15.55:0/2872236729 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510008ab0 con 0x7f35201356c0 2023-09-30T01:56:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f3515ffb700 1 -- 172.21.15.55:0/2872236729 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3510008c10 con 0x7f35201356c0 2023-09-30T01:56:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f3515ffb700 1 -- 172.21.15.55:0/2872236729 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3510026410 con 0x7f35201356c0 2023-09-30T01:56:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f3527d00700 1 -- 172.21.15.55:0/2872236729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3520136500 con 0x7f35201356c0 2023-09-30T01:56:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f3527d00700 1 -- 172.21.15.55:0/2872236729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3520134770 con 0x7f35201356c0 2023-09-30T01:56:08.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.619+0000 7f3527d00700 1 -- 172.21.15.55:0/2872236729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3520068300 con 0x7f35201356c0 2023-09-30T01:56:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.623+0000 7f3515ffb700 1 -- 172.21.15.55:0/2872236729 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f3510003040 con 0x7f35201356c0 2023-09-30T01:56:08.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.623+0000 7f3515ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:08.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.623+0000 7f3515ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:08.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.623+0000 7f3515ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:08.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.623+0000 7f3515ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:08.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.623+0000 7f3515ffb700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f350c08e8e0 0x7f350c090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.623+0000 7f3525a9c700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f350c08e8e0 0x7f350c090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.623+0000 7f3515ffb700 1 -- 172.21.15.55:0/2872236729 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f35100b63f0 con 0x7f35201356c0 2023-09-30T01:56:08.629 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.623+0000 7f3525a9c700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f350c08e8e0 0x7f350c090d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f351c007fd0 tx=0x7f351c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.627+0000 7f3515ffb700 1 -- 172.21.15.55:0/2872236729 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3510086e10 con 0x7f35201356c0 2023-09-30T01:56:08.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.787+0000 7f3527d00700 1 -- 172.21.15.55:0/2872236729 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3520148710 con 0x7f35201356c0 2023-09-30T01:56:08.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.791+0000 7f3515ffb700 1 -- 172.21.15.55:0/2872236729 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+12194 (secure 0 0 0) 0x7f351008a430 con 0x7f35201356c0 2023-09-30T01:56:08.795 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:08.795 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":19,"fsid":"37496c89-c485-46e5-8550-5722d2abf46a","created":"2023-09-30T01:55:38.697831+0000","modified":"2023-09-30T01:56:01.106295+0000","last_up_change":"2023-09-30T01:55:48.191927+0000","last_in_change":"2023-09-30T01:55:39.813210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T01:55:49.090600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T01:55:54.370944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T01:55:58.474504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T01:55:59.107639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27634},{"type":"v1","addr":"172.21.15.55:6801","nonce":27634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27634},{"type":"v1","addr":"172.21.15.55:6803","nonce":27634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27634},{"type":"v1","addr":"172.21.15.55:6807","nonce":27634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27634},{"type":"v1","addr":"172.21.15.55:6805","nonce":27634}]},"public_addr":"172.21.15.55:6801/27634","cluster_addr":"172.21.15.55:6803/27634","heartbeat_back_addr":"172.21.15.55:6807/27634","heartbeat_front_addr":"172.21.15.55:6805/27634","state":["exists","up"]},{"osd":1,"uuid":"b52b4f6f-00aa-4ef8-b3d4-467475cd0bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":30066},{"type":"v1","addr":"172.21.15.133:6809","nonce":30066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":30066},{"type":"v1","addr":"172.21.15.133:6811","nonce":30066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":30066},{"type":"v1","addr":"172.21.15.133:6815","nonce":30066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":30066},{"type":"v1","addr":"172.21.15.133:6813","nonce":30066}]},"public_addr":"172.21.15.133:6809/30066","cluster_addr":"172.21.15.133:6811/30066","heartbeat_back_addr":"172.21.15.133:6815/30066","heartbeat_front_addr":"172.21.15.133:6813/30066","state":["exists","up"]},{"osd":2,"uuid":"c48b2c87-a33c-47fc-8b84-e64faad378b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":30068},{"type":"v1","addr":"172.21.15.133:6817","nonce":30068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":30068},{"type":"v1","addr":"172.21.15.133:6819","nonce":30068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":30068},{"type":"v1","addr":"172.21.15.133:6823","nonce":30068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":30068},{"type":"v1","addr":"172.21.15.133:6821","nonce":30068}]},"public_addr":"172.21.15.133:6817/30068","cluster_addr":"172.21.15.133:6819/30068","heartbeat_back_addr":"172.21.15.133:6823/30068","heartbeat_front_addr":"172.21.15.133:6821/30068","state":["exists","up"]},{"osd":3,"uuid":"614c2d45-f7b8-42e8-ba09-6e042a2358b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":30067},{"type":"v1","addr":"172.21.15.133:6801","nonce":30067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":30067},{"type":"v1","addr":"172.21.15.133:6803","nonce":30067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":30067},{"type":"v1","addr":"172.21.15.133:6807","nonce":30067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":30067},{"type":"v1","addr":"172.21.15.133:6805","nonce":30067}]},"public_addr":"172.21.15.133:6801/30067","cluster_addr":"172.21.15.133:6803/30067","heartbeat_back_addr":"172.21.15.133:6807/30067","heartbeat_front_addr":"172.21.15.133:6805/30067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.342817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.400384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.363652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.069618+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T01:56:08.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.791+0000 7f3527d00700 10 mgrc shutdown 2023-09-30T01:56:08.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.791+0000 7f3527d00700 1 -- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f350c08e8e0 msgr2=0x7f350c090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.791+0000 7f3527d00700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f350c08e8e0 0x7f350c090d90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f351c007fd0 tx=0x7f351c009040 comp rx=0 tx=0).stop 2023-09-30T01:56:08.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.791+0000 7f3527d00700 1 -- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35201356c0 msgr2=0x7f3520135b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.791+0000 7f3527d00700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35201356c0 0x7f3520135b60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3510015000 tx=0x7f3510018000 comp rx=0 tx=0).stop 2023-09-30T01:56:08.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.791+0000 7f3527d00700 1 -- 172.21.15.55:0/2872236729 shutdown_connections 2023-09-30T01:56:08.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.791+0000 7f3527d00700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f35201356c0 0x7f3520135b60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.791+0000 7f3527d00700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3520147ac0 0x7f3520149de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.791+0000 7f3527d00700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f350c08e8e0 0x7f350c090d90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.791+0000 7f3527d00700 1 --2- 172.21.15.55:0/2872236729 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f35200b3060 0x7f35200a9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.791+0000 7f3527d00700 1 -- 172.21.15.55:0/2872236729 >> 172.21.15.55:0/2872236729 conn(0x7f3520068b00 msgr2=0x7f35200a44c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:08.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.795+0000 7f3527d00700 1 -- 172.21.15.55:0/2872236729 shutdown_connections 2023-09-30T01:56:08.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.795+0000 7f3527d00700 1 -- 172.21.15.55:0/2872236729 wait complete. 2023-09-30T01:56:08.811 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-09-30T01:56:08.811 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-09-30T01:56:08.812 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-09-30T01:56:08.812 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-09-30T01:56:08.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ef044700 1 Processor -- start 2023-09-30T01:56:08.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ef044700 1 -- start start 2023-09-30T01:56:08.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ef044700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe3e8070150 0x7fe3e80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ef044700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e806d7e0 0x7fe3e80a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ef044700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3e8070520 con 0x7fe3e806ba10 2023-09-30T01:56:08.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ef044700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe3e806cb50 con 0x7fe3e8070150 2023-09-30T01:56:08.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ef044700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e806bfe0 con 0x7fe3e806d7e0 2023-09-30T01:56:08.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7f8c6d507700 1 Processor -- start 2023-09-30T01:56:08.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ed841700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe3e806ba10 0x7fe3e80a44c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53146/0 (socket says 172.21.15.55:53146) 2023-09-30T01:56:08.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ed841700 1 -- 172.21.15.55:0/187490855 learned_addr learned my addr 172.21.15.55:0/187490855 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:08.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ee843700 1 --2- 172.21.15.55:0/187490855 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e806d7e0 0x7fe3e80a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7f8c6d507700 1 -- start start 2023-09-30T01:56:08.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ee042700 1 --2- 172.21.15.55:0/187490855 >> v2:172.21.15.133:3300/0 conn(0x7fe3e8070150 0x7fe3e80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ee843700 1 -- 172.21.15.55:0/187490855 >> v2:172.21.15.133:3300/0 conn(0x7fe3e8070150 msgr2=0x7fe3e80a58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ee843700 1 --2- 172.21.15.55:0/187490855 >> v2:172.21.15.133:3300/0 conn(0x7fe3e8070150 0x7fe3e80a58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ee843700 1 -- 172.21.15.55:0/187490855 >> v1:172.21.15.55:6789/0 conn(0x7fe3e806ba10 legacy=0x7fe3e80a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ed040700 1 -- 172.21.15.55:0/187490855 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103757315 0 0) 0x7fe3e8070520 con 0x7fe3e806ba10 2023-09-30T01:56:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ee843700 1 -- 172.21.15.55:0/187490855 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e806c2a0 con 0x7fe3e806d7e0 2023-09-30T01:56:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ee843700 1 --2- 172.21.15.55:0/187490855 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e806d7e0 0x7fe3e80a4bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009e90 tx=0x7fe3e0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a5ea4a1559a4e072 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ed040700 1 -- 172.21.15.55:0/187490855 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e000bbf0 con 0x7fe3e806d7e0 2023-09-30T01:56:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ed040700 1 -- 172.21.15.55:0/187490855 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e000bd50 con 0x7fe3e806d7e0 2023-09-30T01:56:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7fe3ed040700 1 -- 172.21.15.55:0/187490855 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0010720 con 0x7fe3e806d7e0 2023-09-30T01:56:08.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7f8c6d507700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c6806d560 0x7f8c680aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7f8c6d507700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c681400a0 con 0x7f8c680a5d50 2023-09-30T01:56:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7f8c667fc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f8c680a5d50 0x7f8c6806ce50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53158/0 (socket says 172.21.15.55:53158) 2023-09-30T01:56:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7f8c667fc700 1 -- 172.21.15.55:0/1819245609 learned_addr learned my addr 172.21.15.55:0/1819245609 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7f8c6d507700 1 -- 172.21.15.55:0/1819245609 --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c68140360 con 0x7f8c68140ae0 2023-09-30T01:56:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7f8c6d507700 1 -- 172.21.15.55:0/1819245609 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c680ab210 con 0x7f8c6806d560 2023-09-30T01:56:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.903+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2328807800 0 0) 0x7f8c681400a0 con 0x7f8c680a5d50 2023-09-30T01:56:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c50003570 con 0x7f8c680a5d50 2023-09-30T01:56:08.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 -- 172.21.15.55:0/187490855 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e806d7e0 msgr2=0x7fe3e80a4bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.914 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 --2- 172.21.15.55:0/187490855 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e806d7e0 0x7fe3e80a4bd0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fe3e0009e90 tx=0x7fe3e0009780 comp rx=0 tx=0).stop 2023-09-30T01:56:08.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208600606 0 0) 0x7f8c68140360 con 0x7f8c68140ae0 2023-09-30T01:56:08.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c681400a0 con 0x7f8c68140ae0 2023-09-30T01:56:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c677fe700 1 --2- 172.21.15.55:0/1819245609 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c6806d560 0x7f8c680aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 480095619 0 0) 0x7f8c50003570 con 0x7f8c680a5d50 2023-09-30T01:56:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c6806d560 msgr2=0x7f8c680aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 --2- 172.21.15.55:0/1819245609 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c6806d560 0x7f8c680aacd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 >> v1:172.21.15.133:6789/0 conn(0x7f8c68140ae0 legacy=0x7f8c6806ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6814d8d0 con 0x7f8c680a5d50 2023-09-30T01:56:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 -- 172.21.15.55:0/187490855 shutdown_connections 2023-09-30T01:56:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 --2- 172.21.15.55:0/187490855 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e806d7e0 0x7fe3e80a4bd0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 --2- 172.21.15.55:0/187490855 >> v2:172.21.15.133:3300/0 conn(0x7fe3e8070150 0x7fe3e80a58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 254224620 0 0) 0x7f8c5c001470 con 0x7f8c680a5d50 2023-09-30T01:56:08.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 -- 172.21.15.55:0/187490855 >> 172.21.15.55:0/187490855 conn(0x7fe3e80b3820 msgr2=0x7fe3e80670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:08.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 >> v1:172.21.15.55:6789/0 conn(0x7f8c680a5d50 legacy=0x7f8c6806ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 --2- 172.21.15.55:0/1819245609 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c6806d560 0x7f8c50004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 -- 172.21.15.55:0/187490855 shutdown_connections 2023-09-30T01:56:08.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 --2- 172.21.15.55:0/1819245609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c500051e0 0x7f8c500037b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 --2- 172.21.15.55:0/1819245609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c50003cf0 0x7f8c50004160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 -- 172.21.15.55:0/187490855 wait complete. 2023-09-30T01:56:08.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c680ab210 con 0x7f8c50003cf0 2023-09-30T01:56:08.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5000bb70 con 0x7f8c500051e0 2023-09-30T01:56:08.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c5000bd30 con 0x7f8c6806d560 2023-09-30T01:56:08.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c677fe700 1 --2- 172.21.15.55:0/1819245609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c50003cf0 0x7f8c50004160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c66ffd700 1 --2- 172.21.15.55:0/1819245609 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c6806d560 0x7f8c50004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c667fc700 1 --2- 172.21.15.55:0/1819245609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c500051e0 0x7f8c500037b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c677fe700 1 -- 172.21.15.55:0/1819245609 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c6806d560 msgr2=0x7f8c50004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:08.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c677fe700 1 --2- 172.21.15.55:0/1819245609 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c6806d560 0x7f8c50004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c677fe700 1 -- 172.21.15.55:0/1819245609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c500051e0 msgr2=0x7f8c500037b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:08.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c677fe700 1 --2- 172.21.15.55:0/1819245609 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c500051e0 0x7f8c500037b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c677fe700 1 -- 172.21.15.55:0/1819245609 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6814d8d0 con 0x7f8c50003cf0 2023-09-30T01:56:08.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c66ffd700 1 --2- 172.21.15.55:0/1819245609 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c6806d560 0x7f8c50004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T01:56:08.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c677fe700 1 --2- 172.21.15.55:0/1819245609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c50003cf0 0x7f8c50004160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000e210 tx=0x7f8c6000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e4c1c2e346d5844 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000eac0 con 0x7f8c50003cf0 2023-09-30T01:56:08.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c6000f040 con 0x7f8c50003cf0 2023-09-30T01:56:08.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c65ffb700 1 -- 172.21.15.55:0/1819245609 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6000ee70 con 0x7f8c50003cf0 2023-09-30T01:56:08.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 Processor -- start 2023-09-30T01:56:08.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 -- start start 2023-09-30T01:56:08.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c6d507700 1 -- 172.21.15.55:0/1819245609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c50003cf0 msgr2=0x7f8c50004160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c6d507700 1 --2- 172.21.15.55:0/1819245609 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c50003cf0 0x7f8c50004160 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8c6000e210 tx=0x7f8c6000b040 comp rx=0 tx=0).stop 2023-09-30T01:56:08.923 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c677fe700 1 -- 172.21.15.55:0/1819245609 reap_dead start 2023-09-30T01:56:08.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c6d507700 1 -- 172.21.15.55:0/1819245609 shutdown_connections 2023-09-30T01:56:08.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c6d507700 1 -- 172.21.15.55:0/1819245609 >> 172.21.15.55:0/1819245609 conn(0x7f8c680b2f00 msgr2=0x7f8c680b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:08.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c6d507700 1 -- 172.21.15.55:0/1819245609 shutdown_connections 2023-09-30T01:56:08.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7f8c6d507700 1 -- 172.21.15.55:0/1819245609 wait complete. 2023-09-30T01:56:08.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e806ba10 0x7fe3e80a50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e806d7e0 0x7fe3e813e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e8070150 0x7fe3e8157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e813fef0 con 0x7fe3e8070150 2023-09-30T01:56:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e8140850 con 0x7fe3e806d7e0 2023-09-30T01:56:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ef044700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3e8140af0 con 0x7fe3e806ba10 2023-09-30T01:56:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ee042700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e806ba10 0x7fe3e80a50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ee843700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e8070150 0x7fe3e8157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ee042700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e806ba10 0x7fe3e80a50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43826/0 (socket says 172.21.15.55:43826) 2023-09-30T01:56:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.907+0000 7fe3ee042700 1 -- 172.21.15.55:0/2459495708 learned_addr learned my addr 172.21.15.55:0/2459495708 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7fe3ed841700 1 --2- 172.21.15.55:0/2459495708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e806d7e0 0x7fe3e813e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.926 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7fe3ee843700 1 -- 172.21.15.55:0/2459495708 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e806ba10 msgr2=0x7fe3e80a50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7fe3ee843700 1 --2- 172.21.15.55:0/2459495708 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe3e806ba10 0x7fe3e80a50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7fe3ee843700 1 -- 172.21.15.55:0/2459495708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e806d7e0 msgr2=0x7fe3e813e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7fe3ee843700 1 --2- 172.21.15.55:0/2459495708 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe3e806d7e0 0x7fe3e813e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7fe3ee843700 1 -- 172.21.15.55:0/2459495708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3e0009a20 con 0x7fe3e8070150 2023-09-30T01:56:08.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7fe3ee843700 1 --2- 172.21.15.55:0/2459495708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e8070150 0x7fe3e8157030 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe3e001a000 tx=0x7fe3e001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7fe3de7fc700 1 -- 172.21.15.55:0/2459495708 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e0026070 con 0x7fe3e8070150 2023-09-30T01:56:08.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7fe3ef044700 1 -- 172.21.15.55:0/2459495708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3e813e9d0 con 0x7fe3e8070150 2023-09-30T01:56:08.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7fe3ef044700 1 -- 172.21.15.55:0/2459495708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3e813f7a0 con 0x7fe3e8070150 2023-09-30T01:56:08.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7fe3de7fc700 1 -- 172.21.15.55:0/2459495708 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3e000f040 con 0x7fe3e8070150 2023-09-30T01:56:08.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7fe3de7fc700 1 -- 172.21.15.55:0/2459495708 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3e000e050 con 0x7fe3e8070150 2023-09-30T01:56:08.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c6d507700 1 Processor -- start 2023-09-30T01:56:08.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c6d507700 1 -- start start 2023-09-30T01:56:08.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7fe3ef044700 1 -- 172.21.15.55:0/2459495708 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe3e8064440 con 0x7fe3e8070150 2023-09-30T01:56:08.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c6d507700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c50003cf0 0x7f8c68138490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c6d507700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c68153ac0 0x7f8c68153e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c6d507700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c681543d0 0x7f8c68141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c6d507700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c680a2100 con 0x7f8c681543d0 2023-09-30T01:56:08.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c6d507700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c681429d0 con 0x7f8c50003cf0 2023-09-30T01:56:08.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c6d507700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6813a210 con 0x7f8c68153ac0 2023-09-30T01:56:08.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c667fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c68153ac0 0x7f8c68153e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c667fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c68153ac0 0x7f8c68153e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43834/0 (socket says 172.21.15.55:43834) 2023-09-30T01:56:08.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c667fc700 1 -- 172.21.15.55:0/2562004676 learned_addr learned my addr 172.21.15.55:0/2562004676 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:08.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c66ffd700 1 --2- 172.21.15.55:0/2562004676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c50003cf0 0x7f8c68138490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c667fc700 1 -- 172.21.15.55:0/2562004676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c50003cf0 msgr2=0x7f8c68138490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c667fc700 1 --2- 172.21.15.55:0/2562004676 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c50003cf0 0x7f8c68138490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c667fc700 1 -- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c681543d0 msgr2=0x7f8c68141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c667fc700 1 --2- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c681543d0 0x7f8c68141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c667fc700 1 -- 172.21.15.55:0/2562004676 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c6813a4b0 con 0x7f8c68153ac0 2023-09-30T01:56:08.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c667fc700 1 --2- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c68153ac0 0x7f8c68153e90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00eb50 tx=0x7f8c5c000c50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c4effd700 1 -- 172.21.15.55:0/2562004676 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c00a830 con 0x7f8c68153ac0 2023-09-30T01:56:08.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c4effd700 1 -- 172.21.15.55:0/2562004676 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c5c010040 con 0x7f8c68153ac0 2023-09-30T01:56:08.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c6d507700 1 -- 172.21.15.55:0/2562004676 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c68139970 con 0x7f8c68153ac0 2023-09-30T01:56:08.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.911+0000 7f8c4effd700 1 -- 172.21.15.55:0/2562004676 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c00abe0 con 0x7f8c68153ac0 2023-09-30T01:56:08.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c6d507700 1 -- 172.21.15.55:0/2562004676 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c681389d0 con 0x7f8c68153ac0 2023-09-30T01:56:08.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7fe3de7fc700 1 -- 172.21.15.55:0/2459495708 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fe3e0003040 con 0x7fe3e8070150 2023-09-30T01:56:08.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7fe3de7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:08.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7fe3de7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:08.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7fe3de7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:08.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7fe3de7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:08.932 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7fe3de7fc700 1 --2- 172.21.15.55:0/2459495708 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe3d408e8f0 0x7fe3d4090da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c6d507700 1 -- 172.21.15.55:0/2562004676 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8c680b3a10 con 0x7f8c68153ac0 2023-09-30T01:56:08.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c4effd700 1 -- 172.21.15.55:0/2562004676 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f8c5c01e440 con 0x7f8c68153ac0 2023-09-30T01:56:08.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c4effd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:08.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7fe3de7fc700 1 -- 172.21.15.55:0/2459495708 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fe3e00b5cc0 con 0x7fe3e8070150 2023-09-30T01:56:08.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7fe3de7fc700 1 --2- 172.21.15.55:0/2459495708 >> [v2:172.21.15.133:6808/30066,v1:172.21.15.133:6809/30066] conn(0x7fe3d4096450 0x7fe3d4098880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7fe3de7fc700 1 -- 172.21.15.55:0/2459495708 --> [v2:172.21.15.133:6808/30066,v1:172.21.15.133:6809/30066] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe3d4098f50 con 0x7fe3d4096450 2023-09-30T01:56:08.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7fe3de7fc700 1 -- 172.21.15.55:0/2459495708 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe3e00ba030 con 0x7fe3e8070150 2023-09-30T01:56:08.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7fe3ed841700 1 --2- 172.21.15.55:0/2459495708 >> [v2:172.21.15.133:6808/30066,v1:172.21.15.133:6809/30066] conn(0x7fe3d4096450 0x7fe3d4098880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7fe3ee042700 1 --2- 172.21.15.55:0/2459495708 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe3d408e8f0 0x7fe3d4090da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7fe3ed841700 1 --2- 172.21.15.55:0/2459495708 >> [v2:172.21.15.133:6808/30066,v1:172.21.15.133:6809/30066] conn(0x7fe3d4096450 0x7fe3d4098880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7fe3ee042700 1 --2- 172.21.15.55:0/2459495708 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe3d408e8f0 0x7fe3d4090da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009dd0 tx=0x7fe3e40091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c4effd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:08.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c4effd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:08.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c4effd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:08.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c4effd700 1 --2- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f8c5408e8b0 0x7f8c54090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c66ffd700 1 --2- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f8c5408e8b0 0x7f8c54090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c4effd700 1 -- 172.21.15.55:0/2562004676 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f8c5c0b4140 con 0x7f8c68153ac0 2023-09-30T01:56:08.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c4effd700 1 --2- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:6800/27634,v1:172.21.15.55:6801/27634] conn(0x7f8c54096410 0x7f8c54098840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c4effd700 1 -- 172.21.15.55:0/2562004676 --> [v2:172.21.15.55:6800/27634,v1:172.21.15.55:6801/27634] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8c54098f10 con 0x7f8c54096410 2023-09-30T01:56:08.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c4effd700 1 -- 172.21.15.55:0/2562004676 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8c5c0b6780 con 0x7f8c68153ac0 2023-09-30T01:56:08.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c677fe700 1 --2- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:6800/27634,v1:172.21.15.55:6801/27634] conn(0x7f8c54096410 0x7f8c54098840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.915+0000 7f8c66ffd700 1 --2- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f8c5408e8b0 0x7f8c54090d60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8c58007fd0 tx=0x7f8c58009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.919+0000 7fe3de7fc700 1 -- 172.21.15.55:0/2459495708 <== osd.1 v2:172.21.15.133:6808/30066 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fe3d4098f50 con 0x7fe3d4096450 2023-09-30T01:56:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.919+0000 7f8c677fe700 1 --2- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:6800/27634,v1:172.21.15.55:6801/27634] conn(0x7f8c54096410 0x7f8c54098840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.919+0000 7f8c4effd700 1 -- 172.21.15.55:0/2562004676 <== osd.0 v2:172.21.15.55:6800/27634 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f8c54098f10 con 0x7f8c54096410 2023-09-30T01:56:08.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.919+0000 7fdf7a074700 1 Processor -- start 2023-09-30T01:56:08.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.919+0000 7fdf7a074700 1 -- start start 2023-09-30T01:56:08.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.919+0000 7fdf7a074700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fdf7406ff20 0x7fdf740a8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.919+0000 7fdf7a074700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf740a7040 0x7fdf740a74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.919+0000 7fdf7a074700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf740a7dd0 con 0x7fdf740702f0 2023-09-30T01:56:08.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.919+0000 7fdf7a074700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf7413dca0 con 0x7fdf740a7040 2023-09-30T01:56:08.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.919+0000 7fdf7a074700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf74142250 con 0x7fdf7406ff20 2023-09-30T01:56:08.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf73fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf740a7040 0x7fdf740a74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf73fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdf740a7040 0x7fdf740a74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39960/0 (socket says 172.21.15.55:39960) 2023-09-30T01:56:08.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf73fff700 1 -- 172.21.15.55:0/1425602890 learned_addr learned my addr 172.21.15.55:0/1425602890 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:08.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf737fe700 1 --2- 172.21.15.55:0/1425602890 >> v2:172.21.15.133:3300/0 conn(0x7fdf7406ff20 0x7fdf740a8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf73fff700 1 -- 172.21.15.55:0/1425602890 >> v2:172.21.15.133:3300/0 conn(0x7fdf7406ff20 msgr2=0x7fdf740a8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:08.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf73fff700 1 --2- 172.21.15.55:0/1425602890 >> v2:172.21.15.133:3300/0 conn(0x7fdf7406ff20 0x7fdf740a8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf73fff700 1 -- 172.21.15.55:0/1425602890 >> v1:172.21.15.55:6789/0 conn(0x7fdf740702f0 legacy=0x7fdf74141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf727fc700 1 -- 172.21.15.55:0/1425602890 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2421572660 0 0) 0x7fdf740a7dd0 con 0x7fdf740702f0 2023-09-30T01:56:08.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf73fff700 1 -- 172.21.15.55:0/1425602890 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf740a8ff0 con 0x7fdf740a7040 2023-09-30T01:56:08.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf73fff700 1 --2- 172.21.15.55:0/1425602890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf740a7040 0x7fdf740a74a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf7406b2d0 tx=0x7fdf6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e15fb67b200f69de server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf727fc700 1 -- 172.21.15.55:0/1425602890 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c00e070 con 0x7fdf740a7040 2023-09-30T01:56:08.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf727fc700 1 -- 172.21.15.55:0/1425602890 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c00bab0 con 0x7fdf740a7040 2023-09-30T01:56:08.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf727fc700 1 -- 172.21.15.55:0/1425602890 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c0092e0 con 0x7fdf740a7040 2023-09-30T01:56:08.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf7a074700 1 -- 172.21.15.55:0/1425602890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf740a7040 msgr2=0x7fdf740a74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf7a074700 1 --2- 172.21.15.55:0/1425602890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf740a7040 0x7fdf740a74a0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdf7406b2d0 tx=0x7fdf6c009840 comp rx=0 tx=0).stop 2023-09-30T01:56:08.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf7a074700 1 -- 172.21.15.55:0/1425602890 shutdown_connections 2023-09-30T01:56:08.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf7a074700 1 --2- 172.21.15.55:0/1425602890 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf740a7040 0x7fdf740a74a0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf7a074700 1 --2- 172.21.15.55:0/1425602890 >> v2:172.21.15.133:3300/0 conn(0x7fdf7406ff20 0x7fdf740a8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf7a074700 1 -- 172.21.15.55:0/1425602890 >> 172.21.15.55:0/1425602890 conn(0x7fdf740b2f00 msgr2=0x7fdf740b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:08.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf7a074700 1 -- 172.21.15.55:0/1425602890 shutdown_connections 2023-09-30T01:56:08.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.923+0000 7fdf7a074700 1 -- 172.21.15.55:0/1425602890 wait complete. 2023-09-30T01:56:08.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf7a074700 1 Processor -- start 2023-09-30T01:56:08.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf7a074700 1 -- start start 2023-09-30T01:56:08.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf7a074700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7406ff20 0x7fdf740af7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf7a074700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf740702f0 0x7fdf740adfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf7a074700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf740a7040 0x7fdf7413c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf7a074700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7413bd90 con 0x7fdf740702f0 2023-09-30T01:56:08.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf7a074700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7413d530 con 0x7fdf7406ff20 2023-09-30T01:56:08.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf7a074700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf740afd20 con 0x7fdf740a7040 2023-09-30T01:56:08.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf72ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf740702f0 0x7fdf740adfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf72ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf740702f0 0x7fdf740adfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39970/0 (socket says 172.21.15.55:39970) 2023-09-30T01:56:08.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf72ffd700 1 -- 172.21.15.55:0/997650672 learned_addr learned my addr 172.21.15.55:0/997650672 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:08.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf73fff700 1 --2- 172.21.15.55:0/997650672 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf740a7040 0x7fdf7413c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.944 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf737fe700 1 --2- 172.21.15.55:0/997650672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7406ff20 0x7fdf740af7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7f594090c700 1 Processor -- start 2023-09-30T01:56:08.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7f594090c700 1 -- start start 2023-09-30T01:56:08.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf72ffd700 1 -- 172.21.15.55:0/997650672 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf740a7040 msgr2=0x7fdf7413c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf72ffd700 1 --2- 172.21.15.55:0/997650672 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdf740a7040 0x7fdf7413c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf72ffd700 1 -- 172.21.15.55:0/997650672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7406ff20 msgr2=0x7fdf740af7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf72ffd700 1 --2- 172.21.15.55:0/997650672 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdf7406ff20 0x7fdf740af7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf72ffd700 1 -- 172.21.15.55:0/997650672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c009ae0 con 0x7fdf740702f0 2023-09-30T01:56:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf72ffd700 1 --2- 172.21.15.55:0/997650672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf740702f0 0x7fdf740adfc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800c810 tx=0x7fdf68007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf5b7fe700 1 -- 172.21.15.55:0/997650672 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68011590 con 0x7fdf740702f0 2023-09-30T01:56:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf7a074700 1 -- 172.21.15.55:0/997650672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7413d2d0 con 0x7fdf740702f0 2023-09-30T01:56:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf5b7fe700 1 -- 172.21.15.55:0/997650672 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf68011710 con 0x7fdf740702f0 2023-09-30T01:56:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf5b7fe700 1 -- 172.21.15.55:0/997650672 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf68011ad0 con 0x7fdf740702f0 2023-09-30T01:56:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.927+0000 7fdf7a074700 1 -- 172.21.15.55:0/997650672 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7413cde0 con 0x7fdf740702f0 2023-09-30T01:56:08.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f594090c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f593c0b3060 0x7f593c0a66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f594090c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f593c140bd0 0x7f593c132be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f594090c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f593c0b3430 con 0x7f593c0a6c00 2023-09-30T01:56:08.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f594090c700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f593c06bff0 con 0x7f593c140bd0 2023-09-30T01:56:08.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f594090c700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c141150 con 0x7f593c0b3060 2023-09-30T01:56:08.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f593a59c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f593c0b3060 0x7f593c0a66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f593a59c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f593c0b3060 0x7f593c0a66c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43858/0 (socket says 172.21.15.55:43858) 2023-09-30T01:56:08.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f593a59c700 1 -- 172.21.15.55:0/727772669 learned_addr learned my addr 172.21.15.55:0/727772669 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:08.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f593ad9d700 1 --2- 172.21.15.55:0/727772669 >> v2:172.21.15.55:3300/0 conn(0x7f593c140bd0 0x7f593c132be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f593a59c700 1 -- 172.21.15.55:0/727772669 >> v2:172.21.15.55:3300/0 conn(0x7f593c140bd0 msgr2=0x7f593c132be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:08.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f593a59c700 1 --2- 172.21.15.55:0/727772669 >> v2:172.21.15.55:3300/0 conn(0x7f593c140bd0 0x7f593c132be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.948 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f593a59c700 1 -- 172.21.15.55:0/727772669 >> v1:172.21.15.133:6789/0 conn(0x7f593c0a6c00 legacy=0x7f593c1404c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f593a59c700 1 -- 172.21.15.55:0/727772669 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f593c06dd60 con 0x7f593c0b3060 2023-09-30T01:56:08.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f593a59c700 1 --2- 172.21.15.55:0/727772669 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f593c0b3060 0x7f593c0a66c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f59300099b0 tx=0x7f5930009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8a6a68ae768b3e6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f593959a700 1 -- 172.21.15.55:0/727772669 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5930009ea0 con 0x7f593c0b3060 2023-09-30T01:56:08.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7fdf5b7fe700 1 -- 172.21.15.55:0/997650672 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fdf6801b3b0 con 0x7fdf740702f0 2023-09-30T01:56:08.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7fdf5b7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:08.949 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f593959a700 1 -- 172.21.15.55:0/727772669 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f593000b860 con 0x7f593c0b3060 2023-09-30T01:56:08.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f593959a700 1 -- 172.21.15.55:0/727772669 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593000bc00 con 0x7f593c0b3060 2023-09-30T01:56:08.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7fdf5b7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:08.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7fdf5b7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:08.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7fdf5b7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:08.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f594090c700 1 -- 172.21.15.55:0/727772669 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f593c0b3060 msgr2=0x7f593c0a66c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.950 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7f594090c700 1 --2- 172.21.15.55:0/727772669 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f593c0b3060 0x7f593c0a66c0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f59300099b0 tx=0x7f5930009250 comp rx=0 tx=0).stop 2023-09-30T01:56:08.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7fdf5b7fe700 1 --2- 172.21.15.55:0/997650672 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdf6008e830 0x7fdf60090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7fdf737fe700 1 --2- 172.21.15.55:0/997650672 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdf6008e830 0x7fdf60090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7fdf5b7fe700 1 -- 172.21.15.55:0/997650672 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fdf680b3e40 con 0x7fdf740702f0 2023-09-30T01:56:08.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.931+0000 7fdf737fe700 1 --2- 172.21.15.55:0/997650672 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdf6008e830 0x7fdf60090ce0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009d40 tx=0x7fdf64008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 -- 172.21.15.55:0/727772669 shutdown_connections 2023-09-30T01:56:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 --2- 172.21.15.55:0/727772669 >> v2:172.21.15.55:3300/0 conn(0x7f593c140bd0 0x7f593c132be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 --2- 172.21.15.55:0/727772669 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f593c0b3060 0x7f593c0a66c0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 -- 172.21.15.55:0/727772669 >> 172.21.15.55:0/727772669 conn(0x7f593c068b00 msgr2=0x7f593c0b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:08.952 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7fdf7a074700 1 --2- 172.21.15.55:0/997650672 >> [v2:172.21.15.133:6816/30068,v1:172.21.15.133:6817/30068] conn(0x7fdf7413c1c0 0x7fdf7413ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7fdf7a074700 1 -- 172.21.15.55:0/997650672 --> [v2:172.21.15.133:6816/30068,v1:172.21.15.133:6817/30068] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdf740acab0 con 0x7fdf7413c1c0 2023-09-30T01:56:08.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 -- 172.21.15.55:0/727772669 shutdown_connections 2023-09-30T01:56:08.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 -- 172.21.15.55:0/727772669 wait complete. 2023-09-30T01:56:08.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7fdf73fff700 1 --2- 172.21.15.55:0/997650672 >> [v2:172.21.15.133:6816/30068,v1:172.21.15.133:6817/30068] conn(0x7fdf7413c1c0 0x7fdf7413ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7fdf73fff700 1 --2- 172.21.15.55:0/997650672 >> [v2:172.21.15.133:6816/30068,v1:172.21.15.133:6817/30068] conn(0x7fdf7413c1c0 0x7fdf7413ad70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 Processor -- start 2023-09-30T01:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 -- start start 2023-09-30T01:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f593c0a6c00 0x7f593c128b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c0b3060 0x7f593c131fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f593c140bd0 0x7f593c130720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c129e90 con 0x7f593c140bd0 2023-09-30T01:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f593c12a0e0 con 0x7f593c0b3060 2023-09-30T01:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f593c0b1900 con 0x7f593c0a6c00 2023-09-30T01:56:08.955 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f593a59c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f593c0a6c00 0x7f593c128b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f593a59c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f593c0a6c00 0x7f593c128b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43872/0 (socket says 172.21.15.55:43872) 2023-09-30T01:56:08.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f593a59c700 1 -- 172.21.15.55:0/3148231996 learned_addr learned my addr 172.21.15.55:0/3148231996 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:08.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f593ad9d700 1 --2- 172.21.15.55:0/3148231996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f593c140bd0 0x7f593c130720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f5939d9b700 1 --2- 172.21.15.55:0/3148231996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c0b3060 0x7f593c131fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f593a59c700 1 -- 172.21.15.55:0/3148231996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c0b3060 msgr2=0x7f593c131fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f593a59c700 1 --2- 172.21.15.55:0/3148231996 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f593c0b3060 0x7f593c131fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f593a59c700 1 -- 172.21.15.55:0/3148231996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f593c140bd0 msgr2=0x7f593c130720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f593a59c700 1 --2- 172.21.15.55:0/3148231996 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f593c140bd0 0x7f593c130720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f593a59c700 1 -- 172.21.15.55:0/3148231996 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59300094f0 con 0x7f593c0a6c00 2023-09-30T01:56:08.956 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7fdf5b7fe700 1 -- 172.21.15.55:0/997650672 <== osd.2 v2:172.21.15.133:6816/30068 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fdf740acab0 con 0x7fdf7413c1c0 2023-09-30T01:56:08.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f593a59c700 1 --2- 172.21.15.55:0/3148231996 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f593c0a6c00 0x7f593c128b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f593c141290 tx=0x7f5930017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f8c6d507700 1 -- 172.21.15.55:0/2562004676 --> [v2:172.21.15.55:6800/27634,v1:172.21.15.55:6801/27634] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8c680a2cc0 con 0x7f8c54096410 2023-09-30T01:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f592a7fc700 1 -- 172.21.15.55:0/3148231996 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f593000bbe0 con 0x7f593c0a6c00 2023-09-30T01:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f592a7fc700 1 -- 172.21.15.55:0/3148231996 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5930011420 con 0x7f593c0a6c00 2023-09-30T01:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 -- 172.21.15.55:0/3148231996 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f593c1296b0 con 0x7f593c0a6c00 2023-09-30T01:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f592a7fc700 1 -- 172.21.15.55:0/3148231996 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59300117c0 con 0x7f593c0a6c00 2023-09-30T01:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f594090c700 1 -- 172.21.15.55:0/3148231996 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f593c129350 con 0x7f593c0a6c00 2023-09-30T01:56:08.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.935+0000 7f8c4effd700 1 -- 172.21.15.55:0/2562004676 <== osd.0 v2:172.21.15.55:6800/27634 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8c680a2cc0 con 0x7f8c54096410 2023-09-30T01:56:08.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f8c6d507700 1 -- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:6800/27634,v1:172.21.15.55:6801/27634] conn(0x7f8c54096410 msgr2=0x7f8c54098840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f8c6d507700 1 --2- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:6800/27634,v1:172.21.15.55:6801/27634] conn(0x7f8c54096410 0x7f8c54098840 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f8c6d507700 10 mgrc shutdown 2023-09-30T01:56:08.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f594090c700 1 -- 172.21.15.55:0/3148231996 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f593c068300 con 0x7f593c0a6c00 2023-09-30T01:56:08.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f8c6d507700 1 -- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f8c5408e8b0 msgr2=0x7f8c54090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f8c6d507700 1 --2- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f8c5408e8b0 0x7f8c54090d60 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8c58007fd0 tx=0x7f8c58009040 comp rx=0 tx=0).stop 2023-09-30T01:56:08.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f8c6d507700 1 -- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c68153ac0 msgr2=0x7f8c68153e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f8c6d507700 1 --2- 172.21.15.55:0/2562004676 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c68153ac0 0x7f8c68153e90 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00eb50 tx=0x7f8c5c000c50 comp rx=0 tx=0).stop 2023-09-30T01:56:08.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f8c677fe700 1 -- 172.21.15.55:0/2562004676 reap_dead start 2023-09-30T01:56:08.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7fe3ef044700 1 -- 172.21.15.55:0/2459495708 --> [v2:172.21.15.133:6808/30066,v1:172.21.15.133:6809/30066] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe3e813a470 con 0x7fe3d4096450 2023-09-30T01:56:08.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f8c6d507700 1 -- 172.21.15.55:0/2562004676 shutdown_connections 2023-09-30T01:56:08.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f8c6d507700 1 -- 172.21.15.55:0/2562004676 >> 172.21.15.55:0/2562004676 conn(0x7f8c680b2f00 msgr2=0x7f8c680670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:08.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f8c6d507700 1 -- 172.21.15.55:0/2562004676 shutdown_connections 2023-09-30T01:56:08.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f8c6d507700 1 -- 172.21.15.55:0/2562004676 wait complete. 2023-09-30T01:56:08.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7fe3de7fc700 1 -- 172.21.15.55:0/2459495708 <== osd.1 v2:172.21.15.133:6808/30066 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe3e813a470 con 0x7fe3d4096450 2023-09-30T01:56:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f592a7fc700 1 -- 172.21.15.55:0/3148231996 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f5930011bf0 con 0x7f593c0a6c00 2023-09-30T01:56:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f592a7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7fe3ef044700 1 -- 172.21.15.55:0/2459495708 >> [v2:172.21.15.133:6808/30066,v1:172.21.15.133:6809/30066] conn(0x7fe3d4096450 msgr2=0x7fe3d4098880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7fe3ef044700 1 --2- 172.21.15.55:0/2459495708 >> [v2:172.21.15.133:6808/30066,v1:172.21.15.133:6809/30066] conn(0x7fe3d4096450 0x7fe3d4098880 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7fe3ef044700 10 mgrc shutdown 2023-09-30T01:56:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f592a7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f592a7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f592a7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:08.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f592a7fc700 1 --2- 172.21.15.55:0/3148231996 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f592408e9d0 0x7f5924090e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7fe3ef044700 1 -- 172.21.15.55:0/2459495708 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe3d408e8f0 msgr2=0x7fe3d4090da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7fe3ef044700 1 --2- 172.21.15.55:0/2459495708 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe3d408e8f0 0x7fe3d4090da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fe3e4009dd0 tx=0x7fe3e40091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7fe3ef044700 1 -- 172.21.15.55:0/2459495708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e8070150 msgr2=0x7fe3e8157030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7fe3ef044700 1 --2- 172.21.15.55:0/2459495708 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe3e8070150 0x7fe3e8157030 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe3e001a000 tx=0x7fe3e001b000 comp rx=0 tx=0).stop 2023-09-30T01:56:08.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7fe3ee843700 1 -- 172.21.15.55:0/2459495708 reap_dead start 2023-09-30T01:56:08.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f592a7fc700 1 -- 172.21.15.55:0/3148231996 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f59300b68f0 con 0x7f593c0a6c00 2023-09-30T01:56:08.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7fe3ef044700 1 -- 172.21.15.55:0/2459495708 shutdown_connections 2023-09-30T01:56:08.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7fe3ef044700 1 -- 172.21.15.55:0/2459495708 >> 172.21.15.55:0/2459495708 conn(0x7fe3e80b3820 msgr2=0x7fe3e813c230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:08.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f592a7fc700 1 --2- 172.21.15.55:0/3148231996 >> [v2:172.21.15.133:6800/30067,v1:172.21.15.133:6801/30067] conn(0x7f5924096530 0x7f5924098960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:08.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f592a7fc700 1 -- 172.21.15.55:0/3148231996 --> [v2:172.21.15.133:6800/30067,v1:172.21.15.133:6801/30067] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5924099030 con 0x7f5924096530 2023-09-30T01:56:08.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f592a7fc700 1 -- 172.21.15.55:0/3148231996 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f59300b6cc0 con 0x7f593c0a6c00 2023-09-30T01:56:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7fe3ef044700 1 -- 172.21.15.55:0/2459495708 shutdown_connections 2023-09-30T01:56:08.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7fe3ef044700 1 -- 172.21.15.55:0/2459495708 wait complete. 2023-09-30T01:56:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.939+0000 7f593ad9d700 1 --2- 172.21.15.55:0/3148231996 >> [v2:172.21.15.133:6800/30067,v1:172.21.15.133:6801/30067] conn(0x7f5924096530 0x7f5924098960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.943+0000 7f593ad9d700 1 --2- 172.21.15.55:0/3148231996 >> [v2:172.21.15.133:6800/30067,v1:172.21.15.133:6801/30067] conn(0x7f5924096530 0x7f5924098960 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:08.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.943+0000 7f592a7fc700 1 -- 172.21.15.55:0/3148231996 <== osd.3 v2:172.21.15.133:6800/30067 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f5924099030 con 0x7f5924096530 2023-09-30T01:56:08.967 INFO:teuthology.orchestra.run.smithi055.stdout:38654705671 2023-09-30T01:56:08.968 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T01:56:08.968 INFO:teuthology.orchestra.run.smithi055.stdout:38654705670 2023-09-30T01:56:08.969 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T01:56:08.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7fdf7a074700 1 -- 172.21.15.55:0/997650672 --> [v2:172.21.15.133:6816/30068,v1:172.21.15.133:6817/30068] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdf740b3a10 con 0x7fdf7413c1c0 2023-09-30T01:56:08.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7f594090c700 1 -- 172.21.15.55:0/3148231996 --> [v2:172.21.15.133:6800/30067,v1:172.21.15.133:6801/30067] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f593c0b08c0 con 0x7f5924096530 2023-09-30T01:56:08.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7fdf5b7fe700 1 -- 172.21.15.55:0/997650672 <== osd.2 v2:172.21.15.133:6816/30068 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdf740b3a10 con 0x7fdf7413c1c0 2023-09-30T01:56:08.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7f592a7fc700 1 -- 172.21.15.55:0/3148231996 <== osd.3 v2:172.21.15.133:6800/30067 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f593c0b08c0 con 0x7f5924096530 2023-09-30T01:56:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7fdf7a074700 1 -- 172.21.15.55:0/997650672 >> [v2:172.21.15.133:6816/30068,v1:172.21.15.133:6817/30068] conn(0x7fdf7413c1c0 msgr2=0x7fdf7413ad70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7fdf7a074700 1 --2- 172.21.15.55:0/997650672 >> [v2:172.21.15.133:6816/30068,v1:172.21.15.133:6817/30068] conn(0x7fdf7413c1c0 0x7fdf7413ad70 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7f594090c700 1 -- 172.21.15.55:0/3148231996 >> [v2:172.21.15.133:6800/30067,v1:172.21.15.133:6801/30067] conn(0x7f5924096530 msgr2=0x7f5924098960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7f594090c700 1 --2- 172.21.15.55:0/3148231996 >> [v2:172.21.15.133:6800/30067,v1:172.21.15.133:6801/30067] conn(0x7f5924096530 0x7f5924098960 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7fdf7a074700 10 mgrc shutdown 2023-09-30T01:56:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7f594090c700 10 mgrc shutdown 2023-09-30T01:56:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7f594090c700 1 -- 172.21.15.55:0/3148231996 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f592408e9d0 msgr2=0x7f5924090e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7f594090c700 1 --2- 172.21.15.55:0/3148231996 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f592408e9d0 0x7f5924090e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7f594090c700 1 -- 172.21.15.55:0/3148231996 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f593c0a6c00 msgr2=0x7f593c128b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7f594090c700 1 --2- 172.21.15.55:0/3148231996 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f593c0a6c00 0x7f593c128b10 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f593c141290 tx=0x7f5930017000 comp rx=0 tx=0).stop 2023-09-30T01:56:08.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7fdf7a074700 1 -- 172.21.15.55:0/997650672 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdf6008e830 msgr2=0x7fdf60090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7fdf7a074700 1 --2- 172.21.15.55:0/997650672 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdf6008e830 0x7fdf60090ce0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fdf64009d40 tx=0x7fdf64008040 comp rx=0 tx=0).stop 2023-09-30T01:56:08.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7fdf7a074700 1 -- 172.21.15.55:0/997650672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf740702f0 msgr2=0x7fdf740adfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:08.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7fdf7a074700 1 --2- 172.21.15.55:0/997650672 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdf740702f0 0x7fdf740adfc0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fdf6800c810 tx=0x7fdf68007df0 comp rx=0 tx=0).stop 2023-09-30T01:56:08.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7f593ad9d700 1 -- 172.21.15.55:0/3148231996 reap_dead start 2023-09-30T01:56:08.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7fdf73fff700 1 -- 172.21.15.55:0/997650672 reap_dead start 2023-09-30T01:56:08.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7f594090c700 1 -- 172.21.15.55:0/3148231996 shutdown_connections 2023-09-30T01:56:08.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7f594090c700 1 -- 172.21.15.55:0/3148231996 >> 172.21.15.55:0/3148231996 conn(0x7f593c068b00 msgr2=0x7f593c124640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:08.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7f594090c700 1 -- 172.21.15.55:0/3148231996 shutdown_connections 2023-09-30T01:56:08.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7fdf7a074700 1 -- 172.21.15.55:0/997650672 shutdown_connections 2023-09-30T01:56:08.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7fdf7a074700 1 -- 172.21.15.55:0/997650672 >> 172.21.15.55:0/997650672 conn(0x7fdf740b2f00 msgr2=0x7fdf740b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:08.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7f594090c700 1 -- 172.21.15.55:0/3148231996 wait complete. 2023-09-30T01:56:08.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7fdf7a074700 1 -- 172.21.15.55:0/997650672 shutdown_connections 2023-09-30T01:56:08.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:08.959+0000 7fdf7a074700 1 -- 172.21.15.55:0/997650672 wait complete. 2023-09-30T01:56:08.978 INFO:teuthology.orchestra.run.smithi055.stdout:38654705671 2023-09-30T01:56:08.979 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T01:56:08.979 INFO:teuthology.orchestra.run.smithi055.stdout:38654705672 2023-09-30T01:56:08.980 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T01:56:09.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.067+0000 7febca0a6700 1 Processor -- start 2023-09-30T01:56:09.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.067+0000 7febca0a6700 1 -- start start 2023-09-30T01:56:09.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.067+0000 7f80c318a700 1 Processor -- start 2023-09-30T01:56:09.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.067+0000 7f80c318a700 1 -- start start 2023-09-30T01:56:09.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febca0a6700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7febc40a8fc0 0x7febc40a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febca0a6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc406d7c0 con 0x7febc406d3f0 2023-09-30T01:56:09.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febca0a6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febc40a6840 con 0x7febc4132c50 2023-09-30T01:56:09.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febca0a6700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febc4133790 con 0x7febc40a8fc0 2023-09-30T01:56:09.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febc2ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7febc40a8fc0 0x7febc40a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febc37fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7febc406d3f0 0x7febc40a4e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53172/0 (socket says 172.21.15.55:53172) 2023-09-30T01:56:09.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febc37fe700 1 -- 172.21.15.55:0/1374834473 learned_addr learned my addr 172.21.15.55:0/1374834473 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:09.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80c318a700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc140ae0 0x7f80bc0aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80c318a700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80bc0a5d50 0x7f80bc06ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80c318a700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80bc1400a0 con 0x7f80bc06ce50 2023-09-30T01:56:09.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80c318a700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc0ab210 con 0x7f80bc0a5d50 2023-09-30T01:56:09.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80c318a700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc140eb0 con 0x7f80bc140ae0 2023-09-30T01:56:09.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febc2ffd700 1 -- 172.21.15.55:0/1374834473 >> v1:172.21.15.133:6789/0 conn(0x7febc4132c50 legacy=0x7febc4133080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:09.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febc2ffd700 1 -- 172.21.15.55:0/1374834473 >> v1:172.21.15.55:6789/0 conn(0x7febc406d3f0 legacy=0x7febc40a4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80bbfff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80bc0a5d50 0x7f80bc06ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80bbfff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80bc0a5d50 0x7f80bc06ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40002/0 (socket says 172.21.15.55:40002) 2023-09-30T01:56:09.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80bbfff700 1 -- 172.21.15.55:0/2939174128 learned_addr learned my addr 172.21.15.55:0/2939174128 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:09.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febc2ffd700 1 -- 172.21.15.55:0/1374834473 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febc40a6b00 con 0x7febc40a8fc0 2023-09-30T01:56:09.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febc2ffd700 1 --2- 172.21.15.55:0/1374834473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc40a8fc0 0x7febc40a44c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7febb80098d0 tx=0x7febb8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c31b37eb56f2f8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:09.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80bbfff700 1 -- 172.21.15.55:0/2939174128 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc140ae0 msgr2=0x7f80bc0aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:09.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80bbfff700 1 --2- 172.21.15.55:0/2939174128 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc140ae0 0x7f80bc0aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80bbfff700 1 -- 172.21.15.55:0/2939174128 >> v1:172.21.15.133:6789/0 conn(0x7f80bc06ce50 legacy=0x7f80bc06d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80bbfff700 1 -- 172.21.15.55:0/2939174128 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc140360 con 0x7f80bc0a5d50 2023-09-30T01:56:09.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febc27fc700 1 -- 172.21.15.55:0/1374834473 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800b550 con 0x7febc40a8fc0 2023-09-30T01:56:09.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febc27fc700 1 -- 172.21.15.55:0/1374834473 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febb800b6b0 con 0x7febc40a8fc0 2023-09-30T01:56:09.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febc27fc700 1 -- 172.21.15.55:0/1374834473 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febb800ba30 con 0x7febc40a8fc0 2023-09-30T01:56:09.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80bbfff700 1 --2- 172.21.15.55:0/2939174128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc0a5d50 0x7f80bc06ff20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0ab350 tx=0x7f80ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a44598511912301b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:09.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80bb7fe700 1 -- 172.21.15.55:0/2939174128 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00b860 con 0x7f80bc0a5d50 2023-09-30T01:56:09.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80bb7fe700 1 -- 172.21.15.55:0/2939174128 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac00b9c0 con 0x7f80bc0a5d50 2023-09-30T01:56:09.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80bb7fe700 1 -- 172.21.15.55:0/2939174128 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac00bd80 con 0x7f80bc0a5d50 2023-09-30T01:56:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febca0a6700 1 -- 172.21.15.55:0/1374834473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc40a8fc0 msgr2=0x7febc40a44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febca0a6700 1 --2- 172.21.15.55:0/1374834473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc40a8fc0 0x7febc40a44c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7febb80098d0 tx=0x7febb8009120 comp rx=0 tx=0).stop 2023-09-30T01:56:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febca0a6700 1 -- 172.21.15.55:0/1374834473 shutdown_connections 2023-09-30T01:56:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febca0a6700 1 --2- 172.21.15.55:0/1374834473 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc40a8fc0 0x7febc40a44c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febca0a6700 1 -- 172.21.15.55:0/1374834473 >> 172.21.15.55:0/1374834473 conn(0x7febc40b2aa0 msgr2=0x7febc40b2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febca0a6700 1 -- 172.21.15.55:0/1374834473 shutdown_connections 2023-09-30T01:56:09.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7febca0a6700 1 -- 172.21.15.55:0/1374834473 wait complete. 2023-09-30T01:56:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80c318a700 1 -- 172.21.15.55:0/2939174128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc0a5d50 msgr2=0x7f80bc06ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80c318a700 1 --2- 172.21.15.55:0/2939174128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc0a5d50 0x7f80bc06ff20 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0ab350 tx=0x7f80ac009250 comp rx=0 tx=0).stop 2023-09-30T01:56:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80c318a700 1 -- 172.21.15.55:0/2939174128 shutdown_connections 2023-09-30T01:56:09.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80c318a700 1 --2- 172.21.15.55:0/2939174128 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc0a5d50 0x7f80bc06ff20 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80c318a700 1 --2- 172.21.15.55:0/2939174128 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc140ae0 0x7f80bc0aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80c318a700 1 -- 172.21.15.55:0/2939174128 >> 172.21.15.55:0/2939174128 conn(0x7f80bc0b2f00 msgr2=0x7f80bc0b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80c318a700 1 -- 172.21.15.55:0/2939174128 shutdown_connections 2023-09-30T01:56:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.071+0000 7f80c318a700 1 -- 172.21.15.55:0/2939174128 wait complete. 2023-09-30T01:56:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febca0a6700 1 Processor -- start 2023-09-30T01:56:09.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febca0a6700 1 -- start start 2023-09-30T01:56:09.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80c318a700 1 Processor -- start 2023-09-30T01:56:09.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80c318a700 1 -- start start 2023-09-30T01:56:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febca0a6700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febc406d3f0 0x7febc40aecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febca0a6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febc40a8fc0 0x7febc40ad480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febca0a6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc4132c50 0x7febc4131800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febca0a6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc40af230 con 0x7febc4132c50 2023-09-30T01:56:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febca0a6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febc40b0850 con 0x7febc40a8fc0 2023-09-30T01:56:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febca0a6700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febc414dfc0 con 0x7febc406d3f0 2023-09-30T01:56:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febc3fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc4132c50 0x7febc4131800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febc37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febc406d3f0 0x7febc40aecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febc37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febc406d3f0 0x7febc40aecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43890/0 (socket says 172.21.15.55:43890) 2023-09-30T01:56:09.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febc37fe700 1 -- 172.21.15.55:0/3536404039 learned_addr learned my addr 172.21.15.55:0/3536404039 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:09.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febc3fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc4132c50 0x7febc4131800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40018/0 (socket says 172.21.15.55:40018) 2023-09-30T01:56:09.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febc2ffd700 1 --2- 172.21.15.55:0/3536404039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febc40a8fc0 0x7febc40ad480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febc3fff700 1 -- 172.21.15.55:0/3536404039 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febc406d3f0 msgr2=0x7febc40aecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febc3fff700 1 --2- 172.21.15.55:0/3536404039 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febc406d3f0 0x7febc40aecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febc3fff700 1 -- 172.21.15.55:0/3536404039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febc40a8fc0 msgr2=0x7febc40ad480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febc3fff700 1 --2- 172.21.15.55:0/3536404039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febc40a8fc0 0x7febc40ad480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febc3fff700 1 -- 172.21.15.55:0/3536404039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb80093c0 con 0x7febc4132c50 2023-09-30T01:56:09.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febc37fe700 1 --2- 172.21.15.55:0/3536404039 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febc406d3f0 0x7febc40aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80c318a700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80bc06ce50 0x7f80bc0ac0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80c318a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc0a5d50 0x7f80bc150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febc3fff700 1 --2- 172.21.15.55:0/3536404039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc4132c50 0x7febc4131800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7febbc00bad0 tx=0x7febbc009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:09.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80c318a700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc140ae0 0x7f80bc150c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80c318a700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0ad0d0 con 0x7f80bc0a5d50 2023-09-30T01:56:09.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80c318a700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc150440 con 0x7f80bc06ce50 2023-09-30T01:56:09.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80c318a700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc148f70 con 0x7f80bc140ae0 2023-09-30T01:56:09.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80c1727700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc140ae0 0x7f80bc150c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80bbfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc0a5d50 0x7f80bc150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80c1727700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc140ae0 0x7f80bc150c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43892/0 (socket says 172.21.15.55:43892) 2023-09-30T01:56:09.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80c1727700 1 -- 172.21.15.55:0/3523303409 learned_addr learned my addr 172.21.15.55:0/3523303409 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:09.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80c0f26700 1 --2- 172.21.15.55:0/3523303409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80bc06ce50 0x7f80bc0ac0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febab7fe700 1 -- 172.21.15.55:0/3536404039 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc00c840 con 0x7febc4132c50 2023-09-30T01:56:09.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febab7fe700 1 -- 172.21.15.55:0/3536404039 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febbc00c9a0 con 0x7febc4132c50 2023-09-30T01:56:09.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febab7fe700 1 -- 172.21.15.55:0/3536404039 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febbc00cd60 con 0x7febc4132c50 2023-09-30T01:56:09.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80bbfff700 1 -- 172.21.15.55:0/3523303409 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc140ae0 msgr2=0x7f80bc150c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80bbfff700 1 --2- 172.21.15.55:0/3523303409 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc140ae0 0x7f80bc150c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80bbfff700 1 -- 172.21.15.55:0/3523303409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80bc06ce50 msgr2=0x7f80bc0ac0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80bbfff700 1 --2- 172.21.15.55:0/3523303409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80bc06ce50 0x7f80bc0ac0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80bbfff700 1 -- 172.21.15.55:0/3523303409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80ac0094f0 con 0x7f80bc0a5d50 2023-09-30T01:56:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80bbfff700 1 --2- 172.21.15.55:0/3523303409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc0a5d50 0x7f80bc150700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0a5830 tx=0x7f80ac016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80b8ff9700 1 -- 172.21.15.55:0/3523303409 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac011de0 con 0x7f80bc0a5d50 2023-09-30T01:56:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80b8ff9700 1 -- 172.21.15.55:0/3523303409 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac01a460 con 0x7f80bc0a5d50 2023-09-30T01:56:09.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80c318a700 1 -- 172.21.15.55:0/3523303409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80bc1482a0 con 0x7f80bc0a5d50 2023-09-30T01:56:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febca0a6700 1 -- 172.21.15.55:0/3536404039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febc40af6d0 con 0x7febc4132c50 2023-09-30T01:56:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7febca0a6700 1 -- 172.21.15.55:0/3536404039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febc4131d40 con 0x7febc4132c50 2023-09-30T01:56:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7febca0a6700 1 -- 172.21.15.55:0/3536404039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febc4069a20 con 0x7febc4132c50 2023-09-30T01:56:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80b8ff9700 1 -- 172.21.15.55:0/3523303409 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac01a820 con 0x7f80bc0a5d50 2023-09-30T01:56:09.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.075+0000 7f80c318a700 1 -- 172.21.15.55:0/3523303409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80bc150210 con 0x7f80bc0a5d50 2023-09-30T01:56:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7febab7fe700 1 -- 172.21.15.55:0/3536404039 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7febbc014620 con 0x7febc4132c50 2023-09-30T01:56:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7febab7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7f80b8ff9700 1 -- 172.21.15.55:0/3523303409 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f80ac01ac10 con 0x7f80bc0a5d50 2023-09-30T01:56:09.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7f80b8ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:09.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7febab7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:09.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7febab7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:09.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7febab7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:09.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7febab7fe700 1 --2- 172.21.15.55:0/3536404039 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7febb0092d90 0x7febb0095240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7febc37fe700 1 --2- 172.21.15.55:0/3536404039 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7febb0092d90 0x7febb0095240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7febab7fe700 1 -- 172.21.15.55:0/3536404039 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7febbc0b4e60 con 0x7febc4132c50 2023-09-30T01:56:09.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7f80b8ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:09.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7f80b8ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:09.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7f80b8ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:09.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7f80b8ff9700 1 --2- 172.21.15.55:0/3523303409 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f80a408ea30 0x7f80a4090ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.079+0000 7f80b8ff9700 1 -- 172.21.15.55:0/3523303409 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f80ac0b5f60 con 0x7f80bc0a5d50 2023-09-30T01:56:09.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.083+0000 7f80c0f26700 1 --2- 172.21.15.55:0/3523303409 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f80a408ea30 0x7f80a4090ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.083+0000 7febc37fe700 1 --2- 172.21.15.55:0/3536404039 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7febb0092d90 0x7febb0095240 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7febb400f3d0 tx=0x7febb4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:09.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.083+0000 7f80c0f26700 1 --2- 172.21.15.55:0/3523303409 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f80a408ea30 0x7f80a4090ee0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f80b4007580 tx=0x7f80b4009780 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:09.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.087+0000 7f80c318a700 1 -- 172.21.15.55:0/3523303409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f809c0050b0 con 0x7f80bc0a5d50 2023-09-30T01:56:09.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.087+0000 7febab7fe700 1 -- 172.21.15.55:0/3536404039 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7febbc085920 con 0x7febc4132c50 2023-09-30T01:56:09.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.095+0000 7f80b8ff9700 1 -- 172.21.15.55:0/3523303409 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f80ac086a20 con 0x7f80bc0a5d50 2023-09-30T01:56:09.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.123+0000 7ff600b9b700 1 Processor -- start 2023-09-30T01:56:09.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.123+0000 7ff600b9b700 1 -- start start 2023-09-30T01:56:09.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff600b9b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff5fc0672d0 0x7ff5fc0a5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff600b9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5fc13f660 0x7ff5fc13fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff600b9b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5fc0a8680 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff600b9b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc0676a0 con 0x7ff5fc13f660 2023-09-30T01:56:09.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff600b9b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5fc0a57b0 con 0x7ff5fc0672d0 2023-09-30T01:56:09.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5faffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7ff5fc0a8b10 0x7ff5fc0a3bc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53182/0 (socket says 172.21.15.55:53182) 2023-09-30T01:56:09.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5faffd700 1 -- 172.21.15.55:0/3319665763 learned_addr learned my addr 172.21.15.55:0/3319665763 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:09.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5fbfff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff5fc13f660 0x7ff5fc13fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5fb7fe700 1 --2- 172.21.15.55:0/3319665763 >> v2:172.21.15.133:3300/0 conn(0x7ff5fc0672d0 0x7ff5fc0a5120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5fa7fc700 1 -- 172.21.15.55:0/3319665763 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419496255 0 0) 0x7ff5fc0a8680 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5fa7fc700 1 -- 172.21.15.55:0/3319665763 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff5e4003570 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5fa7fc700 1 -- 172.21.15.55:0/3319665763 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2790946568 0 0) 0x7ff5e4003570 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5fbfff700 1 -- 172.21.15.55:0/3319665763 >> v2:172.21.15.133:3300/0 conn(0x7ff5fc0672d0 msgr2=0x7ff5fc0a5120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:09.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5fbfff700 1 --2- 172.21.15.55:0/3319665763 >> v2:172.21.15.133:3300/0 conn(0x7ff5fc0672d0 0x7ff5fc0a5120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5fbfff700 1 -- 172.21.15.55:0/3319665763 >> v1:172.21.15.55:6789/0 conn(0x7ff5fc0a8b10 legacy=0x7ff5fc0a3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5fbfff700 1 -- 172.21.15.55:0/3319665763 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc0a5a70 con 0x7ff5fc13f660 2023-09-30T01:56:09.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5fbfff700 1 --2- 172.21.15.55:0/3319665763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5fc13f660 0x7ff5fc13fae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0a7f50 tx=0x7ff5f4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1689fc8f2020871b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:09.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5fa7fc700 1 -- 172.21.15.55:0/3319665763 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f400e070 con 0x7ff5fc13f660 2023-09-30T01:56:09.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5fa7fc700 1 -- 172.21.15.55:0/3319665763 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f400b830 con 0x7ff5fc13f660 2023-09-30T01:56:09.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff5fa7fc700 1 -- 172.21.15.55:0/3319665763 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0001470 con 0x7ff5fc13f660 2023-09-30T01:56:09.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff600b9b700 1 -- 172.21.15.55:0/3319665763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5fc13f660 msgr2=0x7ff5fc13fae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff600b9b700 1 --2- 172.21.15.55:0/3319665763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5fc13f660 0x7ff5fc13fae0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0a7f50 tx=0x7ff5f4009780 comp rx=0 tx=0).stop 2023-09-30T01:56:09.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff600b9b700 1 -- 172.21.15.55:0/3319665763 shutdown_connections 2023-09-30T01:56:09.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff600b9b700 1 --2- 172.21.15.55:0/3319665763 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5fc13f660 0x7ff5fc13fae0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff600b9b700 1 --2- 172.21.15.55:0/3319665763 >> v2:172.21.15.133:3300/0 conn(0x7ff5fc0672d0 0x7ff5fc0a5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff600b9b700 1 -- 172.21.15.55:0/3319665763 >> 172.21.15.55:0/3319665763 conn(0x7ff5fc062c70 msgr2=0x7ff5fc063070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:09.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff600b9b700 1 -- 172.21.15.55:0/3319665763 shutdown_connections 2023-09-30T01:56:09.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.127+0000 7ff600b9b700 1 -- 172.21.15.55:0/3319665763 wait complete. 2023-09-30T01:56:09.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff600b9b700 1 Processor -- start 2023-09-30T01:56:09.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff600b9b700 1 -- start start 2023-09-30T01:56:09.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff600b9b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5fc0672d0 0x7ff5fc09c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff600b9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff5fc0a8b10 0x7ff5fc144950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff600b9b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5fc13f660 0x7ff5fc09ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff600b9b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc146450 con 0x7ff5fc13f660 2023-09-30T01:56:09.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff600b9b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc09bf60 con 0x7ff5fc0672d0 2023-09-30T01:56:09.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff600b9b700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5fc1453b0 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff5faffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff5fc0a8b10 0x7ff5fc144950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff5fbfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5fc13f660 0x7ff5fc09ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff5faffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff5fc0a8b10 0x7ff5fc144950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43900/0 (socket says 172.21.15.55:43900) 2023-09-30T01:56:09.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff5faffd700 1 -- 172.21.15.55:0/4123652152 learned_addr learned my addr 172.21.15.55:0/4123652152 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:09.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff5fb7fe700 1 --2- 172.21.15.55:0/4123652152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5fc0672d0 0x7ff5fc09c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff5faffd700 1 -- 172.21.15.55:0/4123652152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5fc0672d0 msgr2=0x7ff5fc09c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff5faffd700 1 --2- 172.21.15.55:0/4123652152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5fc0672d0 0x7ff5fc09c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff5faffd700 1 -- 172.21.15.55:0/4123652152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5fc13f660 msgr2=0x7ff5fc09ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff5faffd700 1 --2- 172.21.15.55:0/4123652152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5fc13f660 0x7ff5fc09ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff5faffd700 1 -- 172.21.15.55:0/4123652152 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f4009a20 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.131+0000 7ff5faffd700 1 --2- 172.21.15.55:0/4123652152 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff5fc0a8b10 0x7ff5fc144950 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000cb90 tx=0x7ff5f0001ad0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:09.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.135+0000 7ff5e37fe700 1 -- 172.21.15.55:0/4123652152 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0007150 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.135+0000 7ff5e37fe700 1 -- 172.21.15.55:0/4123652152 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f00072d0 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.135+0000 7ff600b9b700 1 -- 172.21.15.55:0/4123652152 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5fc145670 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.135+0000 7ff5e37fe700 1 -- 172.21.15.55:0/4123652152 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f0007690 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.135+0000 7ff600b9b700 1 -- 172.21.15.55:0/4123652152 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5fc09ce10 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.135+0000 7ff600b9b700 1 -- 172.21.15.55:0/4123652152 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5fc064440 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.135+0000 7ff5e37fe700 1 -- 172.21.15.55:0/4123652152 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7ff5f0004a40 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.135+0000 7ff5e37fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:09.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.135+0000 7f2e7fca3700 1 Processor -- start 2023-09-30T01:56:09.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.135+0000 7f2e7fca3700 1 -- start start 2023-09-30T01:56:09.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7ff5e37fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:09.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7ff5e37fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:09.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7ff5e37fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:09.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7ff5e37fe700 1 --2- 172.21.15.55:0/4123652152 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff5e808e8b0 0x7ff5e8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7ff5e37fe700 1 -- 172.21.15.55:0/4123652152 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7ff5f00b4340 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7f2e7fca3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f2e780a5800 0x7f2e780a6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7f2e7fca3700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e78140a90 0x7f2e780afa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7f2e7fca3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e780a5bd0 con 0x7f2e780af610 2023-09-30T01:56:09.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7f2e7fca3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e78140f80 con 0x7f2e780a5800 2023-09-30T01:56:09.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7f2e7fca3700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e78141240 con 0x7f2e78140a90 2023-09-30T01:56:09.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7f2e7e240700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e78140a90 0x7f2e780afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7f2e7e240700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e78140a90 0x7f2e780afa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43912/0 (socket says 172.21.15.55:43912) 2023-09-30T01:56:09.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7f2e7e240700 1 -- 172.21.15.55:0/1052331478 learned_addr learned my addr 172.21.15.55:0/1052331478 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:09.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7f2e7da3f700 1 --2- 172.21.15.55:0/1052331478 >> v2:172.21.15.133:3300/0 conn(0x7f2e780a5800 0x7f2e780a6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7f2e7e240700 1 -- 172.21.15.55:0/1052331478 >> v2:172.21.15.133:3300/0 conn(0x7f2e780a5800 msgr2=0x7f2e780a6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:09.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7f2e7e240700 1 --2- 172.21.15.55:0/1052331478 >> v2:172.21.15.133:3300/0 conn(0x7f2e780a5800 0x7f2e780a6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7f2e7e240700 1 -- 172.21.15.55:0/1052331478 >> v1:172.21.15.133:6789/0 conn(0x7f2e780af610 legacy=0x7f2e78140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7f2e7e240700 1 -- 172.21.15.55:0/1052331478 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e781333f0 con 0x7f2e78140a90 2023-09-30T01:56:09.144 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.139+0000 7f2e7e240700 1 --2- 172.21.15.55:0/1052331478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e78140a90 0x7f2e780afa10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2e7000d1a0 tx=0x7f2e7000ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=54befa6b395ac31a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:09.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.143+0000 7f2e7ca3d700 1 -- 172.21.15.55:0/1052331478 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e70010070 con 0x7f2e78140a90 2023-09-30T01:56:09.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.143+0000 7f2e7ca3d700 1 -- 172.21.15.55:0/1052331478 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7000de10 con 0x7f2e78140a90 2023-09-30T01:56:09.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.143+0000 7f2e7ca3d700 1 -- 172.21.15.55:0/1052331478 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7000b320 con 0x7f2e78140a90 2023-09-30T01:56:09.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.143+0000 7ff5fb7fe700 1 --2- 172.21.15.55:0/4123652152 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff5e808e8b0 0x7ff5e8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.143+0000 7ff5e37fe700 1 -- 172.21.15.55:0/4123652152 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff5f0084e00 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.143+0000 7ff5fb7fe700 1 --2- 172.21.15.55:0/4123652152 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff5e808e8b0 0x7ff5e8090d60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009db0 tx=0x7ff5ec0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:09.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.143+0000 7f2e7fca3700 1 -- 172.21.15.55:0/1052331478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e78140a90 msgr2=0x7f2e780afa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.149 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.143+0000 7f2e7fca3700 1 --2- 172.21.15.55:0/1052331478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e78140a90 0x7f2e780afa10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f2e7000d1a0 tx=0x7f2e7000ba50 comp rx=0 tx=0).stop 2023-09-30T01:56:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.143+0000 7f2e7fca3700 1 -- 172.21.15.55:0/1052331478 shutdown_connections 2023-09-30T01:56:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.143+0000 7f2e7fca3700 1 --2- 172.21.15.55:0/1052331478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e78140a90 0x7f2e780afa10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.143+0000 7f2e7fca3700 1 --2- 172.21.15.55:0/1052331478 >> v2:172.21.15.133:3300/0 conn(0x7f2e780a5800 0x7f2e780a6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7fca3700 1 -- 172.21.15.55:0/1052331478 >> 172.21.15.55:0/1052331478 conn(0x7f2e78063390 msgr2=0x7f2e78068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7fca3700 1 -- 172.21.15.55:0/1052331478 shutdown_connections 2023-09-30T01:56:09.150 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7fca3700 1 -- 172.21.15.55:0/1052331478 wait complete. 2023-09-30T01:56:09.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7fca3700 1 Processor -- start 2023-09-30T01:56:09.151 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7fca3700 1 -- start start 2023-09-30T01:56:09.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7fca3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e780a5800 0x7f2e7812d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7fca3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e780af610 0x7f2e7813f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7fca3700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e78140a90 0x7f2e780a9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7fca3700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7814f0e0 con 0x7f2e780a5800 2023-09-30T01:56:09.152 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7fca3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e7813f800 con 0x7f2e780af610 2023-09-30T01:56:09.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7fca3700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e780aa3d0 con 0x7f2e78140a90 2023-09-30T01:56:09.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7da3f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e780a5800 0x7f2e7812d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7da3f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e780a5800 0x7f2e7812d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40064/0 (socket says 172.21.15.55:40064) 2023-09-30T01:56:09.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7da3f700 1 -- 172.21.15.55:0/383340814 learned_addr learned my addr 172.21.15.55:0/383340814 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:09.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7d23e700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e780af610 0x7f2e7813f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.153 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7e240700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e78140a90 0x7f2e780a9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7da3f700 1 -- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e78140a90 msgr2=0x7f2e780a9e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7da3f700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e78140a90 0x7f2e780a9e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7da3f700 1 -- 172.21.15.55:0/383340814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e780af610 msgr2=0x7f2e7813f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.154 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7da3f700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e780af610 0x7f2e7813f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7da3f700 1 -- 172.21.15.55:0/383340814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e7000bcf0 con 0x7f2e780a5800 2023-09-30T01:56:09.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7e240700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e78140a90 0x7f2e780a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:56:09.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.147+0000 7f2e7da3f700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e780a5800 0x7f2e7812d210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400ec80 tx=0x7f2e740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:09.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.151+0000 7f2e6dffb700 1 -- 172.21.15.55:0/383340814 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400c850 con 0x7f2e780a5800 2023-09-30T01:56:09.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.151+0000 7f2e6dffb700 1 -- 172.21.15.55:0/383340814 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e7400c9b0 con 0x7f2e780a5800 2023-09-30T01:56:09.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.151+0000 7f2e7fca3700 1 -- 172.21.15.55:0/383340814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e780ab1f0 con 0x7f2e780a5800 2023-09-30T01:56:09.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.151+0000 7f2e7fca3700 1 -- 172.21.15.55:0/383340814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e780ab710 con 0x7f2e780a5800 2023-09-30T01:56:09.155 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.151+0000 7f2e6dffb700 1 -- 172.21.15.55:0/383340814 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e7400cd50 con 0x7f2e780a5800 2023-09-30T01:56:09.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.155+0000 7f2e6dffb700 1 -- 172.21.15.55:0/383340814 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f2e74013680 con 0x7f2e780a5800 2023-09-30T01:56:09.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.155+0000 7f2e6dffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:09.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.155+0000 7f2e7fca3700 1 -- 172.21.15.55:0/383340814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e580050b0 con 0x7f2e780a5800 2023-09-30T01:56:09.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.155+0000 7f2e6dffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:09.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.155+0000 7f2e6dffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:09.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.155+0000 7f2e6dffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:09.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.155+0000 7f2e6dffb700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2e5c08e8e0 0x7f2e5c090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.155+0000 7f2e7d23e700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2e5c08e8e0 0x7f2e5c090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.155+0000 7f2e6dffb700 1 -- 172.21.15.55:0/383340814 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f2e740b4d20 con 0x7f2e780a5800 2023-09-30T01:56:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.155+0000 7f2e7d23e700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2e5c08e8e0 0x7f2e5c090d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2e781401d0 tx=0x7f2e68009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.159+0000 7f2e6dffb700 1 -- 172.21.15.55:0/383340814 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2e740857e0 con 0x7f2e780a5800 2023-09-30T01:56:09.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.255+0000 7febca0a6700 1 -- 172.21.15.55:0/3536404039 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7febc413e060 con 0x7febc4132c50 2023-09-30T01:56:09.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.255+0000 7febab7fe700 1 -- 172.21.15.55:0/3536404039 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7febbc022020 con 0x7febc4132c50 2023-09-30T01:56:09.261 INFO:teuthology.orchestra.run.smithi055.stdout:38654705669 2023-09-30T01:56:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.259+0000 7febca0a6700 10 mgrc shutdown 2023-09-30T01:56:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.259+0000 7febca0a6700 1 -- 172.21.15.55:0/3536404039 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7febb0092d90 msgr2=0x7febb0095240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.259+0000 7febca0a6700 1 --2- 172.21.15.55:0/3536404039 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7febb0092d90 0x7febb0095240 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7febb400f3d0 tx=0x7febb4009040 comp rx=0 tx=0).stop 2023-09-30T01:56:09.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.259+0000 7febca0a6700 1 -- 172.21.15.55:0/3536404039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc4132c50 msgr2=0x7febc4131800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.259+0000 7febca0a6700 1 --2- 172.21.15.55:0/3536404039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc4132c50 0x7febc4131800 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7febbc00bad0 tx=0x7febbc009760 comp rx=0 tx=0).stop 2023-09-30T01:56:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.259+0000 7febca0a6700 1 -- 172.21.15.55:0/3536404039 shutdown_connections 2023-09-30T01:56:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.259+0000 7febca0a6700 1 --2- 172.21.15.55:0/3536404039 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7febc4132c50 0x7febc4131800 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.259+0000 7febca0a6700 1 --2- 172.21.15.55:0/3536404039 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7febc40a8fc0 0x7febc40ad480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.259+0000 7febca0a6700 1 --2- 172.21.15.55:0/3536404039 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7febb0092d90 0x7febb0095240 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.259+0000 7febca0a6700 1 --2- 172.21.15.55:0/3536404039 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7febc406d3f0 0x7febc40aecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.259+0000 7febca0a6700 1 -- 172.21.15.55:0/3536404039 >> 172.21.15.55:0/3536404039 conn(0x7febc40b2aa0 msgr2=0x7febc406edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.259+0000 7febca0a6700 1 -- 172.21.15.55:0/3536404039 shutdown_connections 2023-09-30T01:56:09.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.259+0000 7febca0a6700 1 -- 172.21.15.55:0/3536404039 wait complete. 2023-09-30T01:56:09.273 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.0 2023-09-30T01:56:09.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.323+0000 7f80c318a700 1 -- 172.21.15.55:0/3523303409 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f809c005630 con 0x7f80bc0a5d50 2023-09-30T01:56:09.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.323+0000 7f80b8ff9700 1 -- 172.21.15.55:0/3523303409 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f80ac02a030 con 0x7f80bc0a5d50 2023-09-30T01:56:09.328 INFO:teuthology.orchestra.run.smithi055.stdout:38654705670 2023-09-30T01:56:09.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.323+0000 7f2e7fca3700 1 -- 172.21.15.55:0/383340814 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f2e58005630 con 0x7f2e780a5800 2023-09-30T01:56:09.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.323+0000 7f2e6dffb700 1 -- 172.21.15.55:0/383340814 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2e74017090 con 0x7f2e780a5800 2023-09-30T01:56:09.328 INFO:teuthology.orchestra.run.smithi055.stdout:38654705670 2023-09-30T01:56:09.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.323+0000 7f80c318a700 10 mgrc shutdown 2023-09-30T01:56:09.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.323+0000 7f80c318a700 1 -- 172.21.15.55:0/3523303409 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f80a408ea30 msgr2=0x7f80a4090ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.323+0000 7f80c318a700 1 --2- 172.21.15.55:0/3523303409 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f80a408ea30 0x7f80a4090ee0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f80b4007580 tx=0x7f80b4009780 comp rx=0 tx=0).stop 2023-09-30T01:56:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.323+0000 7f80c318a700 1 -- 172.21.15.55:0/3523303409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc0a5d50 msgr2=0x7f80bc150700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.323+0000 7f80c318a700 1 --2- 172.21.15.55:0/3523303409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc0a5d50 0x7f80bc150700 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f80bc0a5830 tx=0x7f80ac016000 comp rx=0 tx=0).stop 2023-09-30T01:56:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f80c318a700 1 -- 172.21.15.55:0/3523303409 shutdown_connections 2023-09-30T01:56:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f80c318a700 1 --2- 172.21.15.55:0/3523303409 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f80a408ea30 0x7f80a4090ee0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f80c318a700 1 --2- 172.21.15.55:0/3523303409 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc140ae0 0x7f80bc150c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f80c318a700 1 --2- 172.21.15.55:0/3523303409 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc0a5d50 0x7f80bc150700 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f80c318a700 1 --2- 172.21.15.55:0/3523303409 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80bc06ce50 0x7f80bc0ac0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f80c318a700 1 -- 172.21.15.55:0/3523303409 >> 172.21.15.55:0/3523303409 conn(0x7f80bc0b2f00 msgr2=0x7f80bc13f720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:09.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f80c318a700 1 -- 172.21.15.55:0/3523303409 shutdown_connections 2023-09-30T01:56:09.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f80c318a700 1 -- 172.21.15.55:0/3523303409 wait complete. 2023-09-30T01:56:09.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f2e7fca3700 10 mgrc shutdown 2023-09-30T01:56:09.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f2e7fca3700 1 -- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2e5c08e8e0 msgr2=0x7f2e5c090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f2e7fca3700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2e5c08e8e0 0x7f2e5c090d90 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2e781401d0 tx=0x7f2e68009040 comp rx=0 tx=0).stop 2023-09-30T01:56:09.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f2e7fca3700 1 -- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e780a5800 msgr2=0x7f2e7812d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f2e7fca3700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e780a5800 0x7f2e7812d210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2e7400ec80 tx=0x7f2e740091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f2e7fca3700 1 -- 172.21.15.55:0/383340814 shutdown_connections 2023-09-30T01:56:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f2e7fca3700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2e5c08e8e0 0x7f2e5c090d90 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f2e7fca3700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2e78140a90 0x7f2e780a9e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f2e7fca3700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2e780af610 0x7f2e7813f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f2e7fca3700 1 --2- 172.21.15.55:0/383340814 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2e780a5800 0x7f2e7812d210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f2e7fca3700 1 -- 172.21.15.55:0/383340814 >> 172.21.15.55:0/383340814 conn(0x7f2e78063390 msgr2=0x7f2e7812f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f2e7fca3700 1 -- 172.21.15.55:0/383340814 shutdown_connections 2023-09-30T01:56:09.333 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.327+0000 7f2e7fca3700 1 -- 172.21.15.55:0/383340814 wait complete. 2023-09-30T01:56:09.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.1 2023-09-30T01:56:09.342 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.3 2023-09-30T01:56:09.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.359+0000 7ff600b9b700 1 -- 172.21.15.55:0/4123652152 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7ff5fc0a4680 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.363+0000 7ff5e37fe700 1 -- 172.21.15.55:0/4123652152 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff5f0018070 con 0x7ff5fc0a8b10 2023-09-30T01:56:09.366 INFO:teuthology.orchestra.run.smithi055.stdout:38654705671 2023-09-30T01:56:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.363+0000 7ff600b9b700 10 mgrc shutdown 2023-09-30T01:56:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.363+0000 7ff600b9b700 1 -- 172.21.15.55:0/4123652152 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff5e808e8b0 msgr2=0x7ff5e8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.363+0000 7ff600b9b700 1 --2- 172.21.15.55:0/4123652152 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff5e808e8b0 0x7ff5e8090d60 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff5ec009db0 tx=0x7ff5ec0091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.363+0000 7ff600b9b700 1 -- 172.21.15.55:0/4123652152 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff5fc0a8b10 msgr2=0x7ff5fc144950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.363+0000 7ff600b9b700 1 --2- 172.21.15.55:0/4123652152 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff5fc0a8b10 0x7ff5fc144950 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000cb90 tx=0x7ff5f0001ad0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.363+0000 7ff600b9b700 1 -- 172.21.15.55:0/4123652152 shutdown_connections 2023-09-30T01:56:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.363+0000 7ff600b9b700 1 --2- 172.21.15.55:0/4123652152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff5fc13f660 0x7ff5fc09ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.363+0000 7ff600b9b700 1 --2- 172.21.15.55:0/4123652152 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff5e808e8b0 0x7ff5e8090d60 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.363+0000 7ff600b9b700 1 --2- 172.21.15.55:0/4123652152 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff5fc0a8b10 0x7ff5fc144950 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.363+0000 7ff600b9b700 1 --2- 172.21.15.55:0/4123652152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff5fc0672d0 0x7ff5fc09c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.363+0000 7ff600b9b700 1 -- 172.21.15.55:0/4123652152 >> 172.21.15.55:0/4123652152 conn(0x7ff5fc062c70 msgr2=0x7ff5fc0b6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.363+0000 7ff600b9b700 1 -- 172.21.15.55:0/4123652152 shutdown_connections 2023-09-30T01:56:09.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:09.363+0000 7ff600b9b700 1 -- 172.21.15.55:0/4123652152 wait complete. 2023-09-30T01:56:09.379 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705671 for osd.2 2023-09-30T01:56:10.275 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-09-30T01:56:10.342 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-09-30T01:56:10.343 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-09-30T01:56:10.380 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-09-30T01:56:10.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cf00e700 1 Processor -- start 2023-09-30T01:56:10.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cf00e700 1 -- start start 2023-09-30T01:56:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cf00e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb6c806ff20 0x7fb6c80a6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cf00e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6c80702f0 0x7fb6c80a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cf00e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6c80a7470 con 0x7fb6c81418d0 2023-09-30T01:56:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cf00e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6c80a78b0 con 0x7fb6c806ff20 2023-09-30T01:56:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cf00e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c80a7fd0 con 0x7fb6c80702f0 2023-09-30T01:56:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6ce80d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb6c81418d0 0x7fb6c806b410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53188/0 (socket says 172.21.15.55:53188) 2023-09-30T01:56:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6ce80d700 1 -- 172.21.15.55:0/4115807535 learned_addr learned my addr 172.21.15.55:0/4115807535 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cd80b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6c80702f0 0x7fb6c80a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6ce00c700 1 --2- 172.21.15.55:0/4115807535 >> v2:172.21.15.133:3300/0 conn(0x7fb6c806ff20 0x7fb6c80a6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cd00a700 1 -- 172.21.15.55:0/4115807535 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2406133254 0 0) 0x7fb6c0001490 con 0x7fb6c81418d0 2023-09-30T01:56:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cd00a700 1 -- 172.21.15.55:0/4115807535 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb6b4003570 con 0x7fb6c81418d0 2023-09-30T01:56:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cd80b700 1 -- 172.21.15.55:0/4115807535 >> v2:172.21.15.133:3300/0 conn(0x7fb6c806ff20 msgr2=0x7fb6c80a6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cd80b700 1 --2- 172.21.15.55:0/4115807535 >> v2:172.21.15.133:3300/0 conn(0x7fb6c806ff20 0x7fb6c80a6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cd80b700 1 -- 172.21.15.55:0/4115807535 >> v1:172.21.15.55:6789/0 conn(0x7fb6c81418d0 legacy=0x7fb6c806b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cd80b700 1 -- 172.21.15.55:0/4115807535 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c80a8de0 con 0x7fb6c80702f0 2023-09-30T01:56:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cd80b700 1 --2- 172.21.15.55:0/4115807535 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6c80702f0 0x7fb6c80a84d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40098e0 tx=0x7fb6c40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=758ea6d1fa9b6f88 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cd00a700 1 -- 172.21.15.55:0/4115807535 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4011630 con 0x7fb6c80702f0 2023-09-30T01:56:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cd00a700 1 -- 172.21.15.55:0/4115807535 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c4011790 con 0x7fb6c80702f0 2023-09-30T01:56:10.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cd00a700 1 -- 172.21.15.55:0/4115807535 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4011b30 con 0x7fb6c80702f0 2023-09-30T01:56:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cf00e700 1 -- 172.21.15.55:0/4115807535 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6c80702f0 msgr2=0x7fb6c80a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cf00e700 1 --2- 172.21.15.55:0/4115807535 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6c80702f0 0x7fb6c80a84d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb6c40098e0 tx=0x7fb6c40091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cf00e700 1 -- 172.21.15.55:0/4115807535 shutdown_connections 2023-09-30T01:56:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cf00e700 1 --2- 172.21.15.55:0/4115807535 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6c80702f0 0x7fb6c80a84d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cf00e700 1 --2- 172.21.15.55:0/4115807535 >> v2:172.21.15.133:3300/0 conn(0x7fb6c806ff20 0x7fb6c80a6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cf00e700 1 -- 172.21.15.55:0/4115807535 >> 172.21.15.55:0/4115807535 conn(0x7fb6c806a610 msgr2=0x7fb6c80b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.403+0000 7fb6cf00e700 1 -- 172.21.15.55:0/4115807535 shutdown_connections 2023-09-30T01:56:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cf00e700 1 -- 172.21.15.55:0/4115807535 wait complete. 2023-09-30T01:56:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cf00e700 1 Processor -- start 2023-09-30T01:56:10.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cf00e700 1 -- start start 2023-09-30T01:56:10.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cf00e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c806ff20 0x7fb6c813e340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cf00e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c81418d0 0x7fb6c80b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cf00e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6c80b14f0 0x7fb6c80af830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cf00e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c8145e80 con 0x7fb6c81418d0 2023-09-30T01:56:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cf00e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c806c6a0 con 0x7fb6c806ff20 2023-09-30T01:56:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cf00e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c806c940 con 0x7fb6c80b14f0 2023-09-30T01:56:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6ce80d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6c80b14f0 0x7fb6c80af830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cd80b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c81418d0 0x7fb6c80b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6ce80d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6c80b14f0 0x7fb6c80af830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43942/0 (socket says 172.21.15.55:43942) 2023-09-30T01:56:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6ce80d700 1 -- 172.21.15.55:0/664870674 learned_addr learned my addr 172.21.15.55:0/664870674 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:10.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6ce00c700 1 --2- 172.21.15.55:0/664870674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c806ff20 0x7fb6c813e340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cd80b700 1 -- 172.21.15.55:0/664870674 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6c80b14f0 msgr2=0x7fb6c80af830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cd80b700 1 --2- 172.21.15.55:0/664870674 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6c80b14f0 0x7fb6c80af830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cd80b700 1 -- 172.21.15.55:0/664870674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c806ff20 msgr2=0x7fb6c813e340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cd80b700 1 --2- 172.21.15.55:0/664870674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c806ff20 0x7fb6c813e340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cd80b700 1 -- 172.21.15.55:0/664870674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6c4009420 con 0x7fb6c81418d0 2023-09-30T01:56:10.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6ce80d700 1 --2- 172.21.15.55:0/664870674 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6c80b14f0 0x7fb6c80af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:10.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.407+0000 7fb6cd80b700 1 --2- 172.21.15.55:0/664870674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c81418d0 0x7fb6c80b0fb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4016000 tx=0x7fb6c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.411+0000 7fb6be7fc700 1 -- 172.21.15.55:0/664870674 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4011900 con 0x7fb6c81418d0 2023-09-30T01:56:10.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.411+0000 7fb6be7fc700 1 -- 172.21.15.55:0/664870674 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6c4011aa0 con 0x7fb6c81418d0 2023-09-30T01:56:10.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.411+0000 7fb6cf00e700 1 -- 172.21.15.55:0/664870674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c806e440 con 0x7fb6c81418d0 2023-09-30T01:56:10.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.411+0000 7fb6be7fc700 1 -- 172.21.15.55:0/664870674 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6c4025640 con 0x7fb6c81418d0 2023-09-30T01:56:10.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.411+0000 7fb6cf00e700 1 -- 172.21.15.55:0/664870674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c806d770 con 0x7fb6c81418d0 2023-09-30T01:56:10.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.411+0000 7fb6be7fc700 1 -- 172.21.15.55:0/664870674 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fb6c40193b0 con 0x7fb6c81418d0 2023-09-30T01:56:10.416 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.411+0000 7fb6be7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.411+0000 7fb6be7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.411+0000 7fb6be7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.411+0000 7fb6be7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:10.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.411+0000 7fb6be7fc700 1 --2- 172.21.15.55:0/664870674 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb6ac08e900 0x7fb6ac090db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.415+0000 7fb6ce00c700 1 --2- 172.21.15.55:0/664870674 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb6ac08e900 0x7fb6ac090db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.415+0000 7fb6be7fc700 1 -- 172.21.15.55:0/664870674 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fb6c40b5dd0 con 0x7fb6c81418d0 2023-09-30T01:56:10.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.415+0000 7fb6ce00c700 1 --2- 172.21.15.55:0/664870674 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb6ac08e900 0x7fb6ac090db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8009db0 tx=0x7fb6b80091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.419+0000 7fb6abfff700 1 -- 172.21.15.55:0/664870674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c8064440 con 0x7fb6c81418d0 2023-09-30T01:56:10.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.427+0000 7fb6be7fc700 1 -- 172.21.15.55:0/664870674 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb6c4086890 con 0x7fb6c81418d0 2023-09-30T01:56:10.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5efc7700 1 Processor -- start 2023-09-30T01:56:10.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5efc7700 1 -- start start 2023-09-30T01:56:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5efc7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd580a5800 0x7fdd580a6640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5efc7700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd580a5bd0 con 0x7fdd580af610 2023-09-30T01:56:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5efc7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd58140f80 con 0x7fdd58140a90 2023-09-30T01:56:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5efc7700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd58141240 con 0x7fdd580a5800 2023-09-30T01:56:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5cd63700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd580a5800 0x7fdd580a6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5cd63700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd580a5800 0x7fdd580a6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40074/0 (socket says 172.21.15.55:40074) 2023-09-30T01:56:10.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5cd63700 1 -- 172.21.15.55:0/3711216070 learned_addr learned my addr 172.21.15.55:0/3711216070 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5cd63700 1 -- 172.21.15.55:0/3711216070 >> v1:172.21.15.133:6789/0 conn(0x7fdd58140a90 legacy=0x7fdd581476c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5cd63700 1 -- 172.21.15.55:0/3711216070 >> v1:172.21.15.55:6789/0 conn(0x7fdd580af610 legacy=0x7fdd58140380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5cd63700 1 -- 172.21.15.55:0/3711216070 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd581333f0 con 0x7fdd580a5800 2023-09-30T01:56:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5cd63700 1 --2- 172.21.15.55:0/3711216070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd580a5800 0x7fdd580a6640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800d1a0 tx=0x7fdd4800ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b4863450db9b0a4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd577fe700 1 -- 172.21.15.55:0/3711216070 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd48010070 con 0x7fdd580a5800 2023-09-30T01:56:10.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd577fe700 1 -- 172.21.15.55:0/3711216070 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4800de80 con 0x7fdd580a5800 2023-09-30T01:56:10.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd577fe700 1 -- 172.21.15.55:0/3711216070 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800b320 con 0x7fdd580a5800 2023-09-30T01:56:10.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5efc7700 1 -- 172.21.15.55:0/3711216070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd580a5800 msgr2=0x7fdd580a6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.443+0000 7fdd5efc7700 1 --2- 172.21.15.55:0/3711216070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd580a5800 0x7fdd580a6640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800d1a0 tx=0x7fdd4800ba50 comp rx=0 tx=0).stop 2023-09-30T01:56:10.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 -- 172.21.15.55:0/3711216070 shutdown_connections 2023-09-30T01:56:10.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 --2- 172.21.15.55:0/3711216070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd580a5800 0x7fdd580a6640 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 -- 172.21.15.55:0/3711216070 >> 172.21.15.55:0/3711216070 conn(0x7fdd58063390 msgr2=0x7fdd58068b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:10.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 -- 172.21.15.55:0/3711216070 shutdown_connections 2023-09-30T01:56:10.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 -- 172.21.15.55:0/3711216070 wait complete. 2023-09-30T01:56:10.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 Processor -- start 2023-09-30T01:56:10.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 -- start start 2023-09-30T01:56:10.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd580a5800 0x7fdd580acda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd580af610 0x7fdd5813f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd58140a90 0x7fdd5812c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd580ac3d0 con 0x7fdd58140a90 2023-09-30T01:56:10.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd581545e0 con 0x7fdd580a5800 2023-09-30T01:56:10.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd580ad2e0 con 0x7fdd580af610 2023-09-30T01:56:10.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5d564700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd58140a90 0x7fdd5812c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5d564700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd58140a90 0x7fdd5812c030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40088/0 (socket says 172.21.15.55:40088) 2023-09-30T01:56:10.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5d564700 1 -- 172.21.15.55:0/2187207229 learned_addr learned my addr 172.21.15.55:0/2187207229 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5cd63700 1 --2- 172.21.15.55:0/2187207229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd580a5800 0x7fdd580acda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd57fff700 1 --2- 172.21.15.55:0/2187207229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd580af610 0x7fdd5813f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5d564700 1 -- 172.21.15.55:0/2187207229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd580af610 msgr2=0x7fdd5813f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5d564700 1 --2- 172.21.15.55:0/2187207229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd580af610 0x7fdd5813f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5d564700 1 -- 172.21.15.55:0/2187207229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd580a5800 msgr2=0x7fdd580acda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5d564700 1 --2- 172.21.15.55:0/2187207229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd580a5800 0x7fdd580acda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5d564700 1 -- 172.21.15.55:0/2187207229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4800bcf0 con 0x7fdd58140a90 2023-09-30T01:56:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5d564700 1 --2- 172.21.15.55:0/2187207229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd58140a90 0x7fdd5812c030 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000b5e0 tx=0x7fdd50009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd54ff9700 1 -- 172.21.15.55:0/2187207229 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000f510 con 0x7fdd58140a90 2023-09-30T01:56:10.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd54ff9700 1 -- 172.21.15.55:0/2187207229 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd5000f670 con 0x7fdd58140a90 2023-09-30T01:56:10.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 -- 172.21.15.55:0/2187207229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd58153c00 con 0x7fdd58140a90 2023-09-30T01:56:10.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.447+0000 7fdd5efc7700 1 -- 172.21.15.55:0/2187207229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd58151220 con 0x7fdd58140a90 2023-09-30T01:56:10.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.451+0000 7fdd54ff9700 1 -- 172.21.15.55:0/2187207229 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd5000fa30 con 0x7fdd58140a90 2023-09-30T01:56:10.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.451+0000 7fdd54ff9700 1 -- 172.21.15.55:0/2187207229 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fdd5001a400 con 0x7fdd58140a90 2023-09-30T01:56:10.455 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.451+0000 7fdd54ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:10.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.451+0000 7fdd54ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:10.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.451+0000 7fdd54ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:10.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.451+0000 7fdd54ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:10.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.451+0000 7fdd54ff9700 1 --2- 172.21.15.55:0/2187207229 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdd4408e8b0 0x7fdd44090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.455+0000 7fdd5cd63700 1 --2- 172.21.15.55:0/2187207229 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdd4408e8b0 0x7fdd44090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.455+0000 7fdd5efc7700 1 -- 172.21.15.55:0/2187207229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd380050b0 con 0x7fdd58140a90 2023-09-30T01:56:10.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.455+0000 7fdd54ff9700 1 -- 172.21.15.55:0/2187207229 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fdd500b4220 con 0x7fdd58140a90 2023-09-30T01:56:10.458 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.455+0000 7fdd5cd63700 1 --2- 172.21.15.55:0/2187207229 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdd4408e8b0 0x7fdd44090d60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800ba90 tx=0x7fdd48019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feed33df700 1 Processor -- start 2023-09-30T01:56:10.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feed33df700 1 -- start start 2023-09-30T01:56:10.462 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7fdd54ff9700 1 -- 172.21.15.55:0/2187207229 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdd50084c50 con 0x7fdd58140a90 2023-09-30T01:56:10.463 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feed33df700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feecc06be70 0x7feecc136400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feed33df700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feecc06d660 con 0x7feecc0abf10 2023-09-30T01:56:10.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feed33df700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feecc0b3e10 con 0x7feecc0b3a40 2023-09-30T01:56:10.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feed33df700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feecc06dbe0 con 0x7feecc06be70 2023-09-30T01:56:10.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feed097a700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feecc0abf10 0x7feecc135cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53196/0 (socket says 172.21.15.55:53196) 2023-09-30T01:56:10.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feed097a700 1 -- 172.21.15.55:0/3576309138 learned_addr learned my addr 172.21.15.55:0/3576309138 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:10.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feed197c700 1 --2- 172.21.15.55:0/3576309138 >> v2:172.21.15.133:3300/0 conn(0x7feecc06be70 0x7feecc136400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feec3fff700 1 -- 172.21.15.55:0/3576309138 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4084603054 0 0) 0x7feecc06d660 con 0x7feecc0abf10 2023-09-30T01:56:10.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feec3fff700 1 -- 172.21.15.55:0/3576309138 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feeb8003570 con 0x7feecc0abf10 2023-09-30T01:56:10.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feed197c700 1 -- 172.21.15.55:0/3576309138 >> v1:172.21.15.133:6789/0 conn(0x7feecc0b3a40 legacy=0x7feecc143e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feed197c700 1 -- 172.21.15.55:0/3576309138 >> v1:172.21.15.55:6789/0 conn(0x7feecc0abf10 legacy=0x7feecc135cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feed197c700 1 -- 172.21.15.55:0/3576309138 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc06c3b0 con 0x7feecc06be70 2023-09-30T01:56:10.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.459+0000 7feed197c700 1 --2- 172.21.15.55:0/3576309138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feecc06be70 0x7feecc136400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feec4009e60 tx=0x7feec4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c334d173f4764041 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feec3fff700 1 -- 172.21.15.55:0/3576309138 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec400e070 con 0x7feecc06be70 2023-09-30T01:56:10.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feec3fff700 1 -- 172.21.15.55:0/3576309138 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec400bb60 con 0x7feecc06be70 2023-09-30T01:56:10.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feec3fff700 1 -- 172.21.15.55:0/3576309138 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4012430 con 0x7feecc06be70 2023-09-30T01:56:10.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 -- 172.21.15.55:0/3576309138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feecc06be70 msgr2=0x7feecc136400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 --2- 172.21.15.55:0/3576309138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feecc06be70 0x7feecc136400 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feec4009e60 tx=0x7feec4009780 comp rx=0 tx=0).stop 2023-09-30T01:56:10.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 -- 172.21.15.55:0/3576309138 shutdown_connections 2023-09-30T01:56:10.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 --2- 172.21.15.55:0/3576309138 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feecc06be70 0x7feecc136400 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 -- 172.21.15.55:0/3576309138 >> 172.21.15.55:0/3576309138 conn(0x7feecc062c70 msgr2=0x7feecc063070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:10.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 -- 172.21.15.55:0/3576309138 shutdown_connections 2023-09-30T01:56:10.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 -- 172.21.15.55:0/3576309138 wait complete. 2023-09-30T01:56:10.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 Processor -- start 2023-09-30T01:56:10.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 -- start start 2023-09-30T01:56:10.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc06be70 0x7feecc132d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feecc0abf10 0x7feecc0ad660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feecc0b3a40 0x7feecc12d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc0adba0 con 0x7feecc06be70 2023-09-30T01:56:10.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc12cc40 con 0x7feecc0b3a40 2023-09-30T01:56:10.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed33df700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc1530c0 con 0x7feecc0abf10 2023-09-30T01:56:10.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed117b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc06be70 0x7feecc132d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed117b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc06be70 0x7feecc132d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40092/0 (socket says 172.21.15.55:40092) 2023-09-30T01:56:10.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed117b700 1 -- 172.21.15.55:0/473983109 learned_addr learned my addr 172.21.15.55:0/473983109 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:10.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed197c700 1 --2- 172.21.15.55:0/473983109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feecc0b3a40 0x7feecc12d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed097a700 1 --2- 172.21.15.55:0/473983109 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feecc0abf10 0x7feecc0ad660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed117b700 1 -- 172.21.15.55:0/473983109 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feecc0abf10 msgr2=0x7feecc0ad660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed117b700 1 --2- 172.21.15.55:0/473983109 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feecc0abf10 0x7feecc0ad660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed117b700 1 -- 172.21.15.55:0/473983109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feecc0b3a40 msgr2=0x7feecc12d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed117b700 1 --2- 172.21.15.55:0/473983109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feecc0b3a40 0x7feecc12d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.463+0000 7feed117b700 1 -- 172.21.15.55:0/473983109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec4009a20 con 0x7feecc06be70 2023-09-30T01:56:10.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.467+0000 7feed117b700 1 --2- 172.21.15.55:0/473983109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc06be70 0x7feecc132d30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feec800c4e0 tx=0x7feec800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.471+0000 7feec17fa700 1 -- 172.21.15.55:0/473983109 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8011590 con 0x7feecc06be70 2023-09-30T01:56:10.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.471+0000 7feed33df700 1 -- 172.21.15.55:0/473983109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc153380 con 0x7feecc06be70 2023-09-30T01:56:10.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.471+0000 7feec17fa700 1 -- 172.21.15.55:0/473983109 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec8011710 con 0x7feecc06be70 2023-09-30T01:56:10.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.471+0000 7feec17fa700 1 -- 172.21.15.55:0/473983109 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec8011ad0 con 0x7feecc06be70 2023-09-30T01:56:10.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.471+0000 7feed33df700 1 -- 172.21.15.55:0/473983109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc12d610 con 0x7feecc06be70 2023-09-30T01:56:10.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.475+0000 7feed33df700 1 -- 172.21.15.55:0/473983109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feecc12cdb0 con 0x7feecc06be70 2023-09-30T01:56:10.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.475+0000 7feec17fa700 1 -- 172.21.15.55:0/473983109 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7feec801b3b0 con 0x7feecc06be70 2023-09-30T01:56:10.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.475+0000 7feec17fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:10.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.475+0000 7feec17fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:10.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.475+0000 7feec17fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:10.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.475+0000 7feec17fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:10.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.475+0000 7feec17fa700 1 --2- 172.21.15.55:0/473983109 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7feeb008e8b0 0x7feeb0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.475+0000 7feed097a700 1 --2- 172.21.15.55:0/473983109 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7feeb008e8b0 0x7feeb0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.475+0000 7feec17fa700 1 -- 172.21.15.55:0/473983109 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7feec80b5c30 con 0x7feecc06be70 2023-09-30T01:56:10.480 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.475+0000 7feed097a700 1 --2- 172.21.15.55:0/473983109 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7feeb008e8b0 0x7feeb0090d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feecc1334d0 tx=0x7feebc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.479+0000 7feec17fa700 1 -- 172.21.15.55:0/473983109 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7feec80b9060 con 0x7feecc06be70 2023-09-30T01:56:10.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc708da5700 1 Processor -- start 2023-09-30T01:56:10.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc708da5700 1 -- start start 2023-09-30T01:56:10.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc708da5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc7040680b0 0x7fc7040a6b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc708da5700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc704068480 0x7fc70406b410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc708da5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7041328a0 0x7fc70406d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc708da5700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70406e450 con 0x7fc7041328a0 2023-09-30T01:56:10.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc708da5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7040a7070 con 0x7fc7040680b0 2023-09-30T01:56:10.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc708da5700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70406be30 con 0x7fc704068480 2023-09-30T01:56:10.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc702ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc704068480 0x7fc70406b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc703fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc7041328a0 0x7fc70406d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc702ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc704068480 0x7fc70406b410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43978/0 (socket says 172.21.15.55:43978) 2023-09-30T01:56:10.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc702ffd700 1 -- 172.21.15.55:0/3557193110 learned_addr learned my addr 172.21.15.55:0/3557193110 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:10.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc7037fe700 1 --2- 172.21.15.55:0/3557193110 >> v2:172.21.15.133:3300/0 conn(0x7fc7040680b0 0x7fc7040a6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc702ffd700 1 -- 172.21.15.55:0/3557193110 >> v2:172.21.15.133:3300/0 conn(0x7fc7040680b0 msgr2=0x7fc7040a6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:10.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc702ffd700 1 --2- 172.21.15.55:0/3557193110 >> v2:172.21.15.133:3300/0 conn(0x7fc7040680b0 0x7fc7040a6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc702ffd700 1 -- 172.21.15.55:0/3557193110 >> v2:172.21.15.55:3300/0 conn(0x7fc7041328a0 msgr2=0x7fc70406d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:10.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc702ffd700 1 --2- 172.21.15.55:0/3557193110 >> v2:172.21.15.55:3300/0 conn(0x7fc7041328a0 0x7fc70406d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc702ffd700 1 -- 172.21.15.55:0/3557193110 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70406c0f0 con 0x7fc704068480 2023-09-30T01:56:10.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc702ffd700 1 --2- 172.21.15.55:0/3557193110 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc704068480 0x7fc70406b410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc7040a53e0 tx=0x7fc6f800a200 comp rx=0 tx=0).ready entity=mon.2 client_cookie=903ba566b6e3a29e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc7027fc700 1 -- 172.21.15.55:0/3557193110 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8009030 con 0x7fc704068480 2023-09-30T01:56:10.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc7027fc700 1 -- 172.21.15.55:0/3557193110 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f800be60 con 0x7fc704068480 2023-09-30T01:56:10.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.499+0000 7fc7027fc700 1 -- 172.21.15.55:0/3557193110 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800cdb0 con 0x7fc704068480 2023-09-30T01:56:10.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 -- 172.21.15.55:0/3557193110 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc704068480 msgr2=0x7fc70406b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 --2- 172.21.15.55:0/3557193110 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc704068480 0x7fc70406b410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc7040a53e0 tx=0x7fc6f800a200 comp rx=0 tx=0).stop 2023-09-30T01:56:10.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 -- 172.21.15.55:0/3557193110 shutdown_connections 2023-09-30T01:56:10.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 --2- 172.21.15.55:0/3557193110 >> v2:172.21.15.55:3300/0 conn(0x7fc7041328a0 0x7fc70406d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 --2- 172.21.15.55:0/3557193110 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc704068480 0x7fc70406b410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 --2- 172.21.15.55:0/3557193110 >> v2:172.21.15.133:3300/0 conn(0x7fc7040680b0 0x7fc7040a6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 -- 172.21.15.55:0/3557193110 >> 172.21.15.55:0/3557193110 conn(0x7fc70406a610 msgr2=0x7fc7040b2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:10.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 -- 172.21.15.55:0/3557193110 shutdown_connections 2023-09-30T01:56:10.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 -- 172.21.15.55:0/3557193110 wait complete. 2023-09-30T01:56:10.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 Processor -- start 2023-09-30T01:56:10.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 -- start start 2023-09-30T01:56:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7040680b0 0x7fc70412b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc704068480 0x7fc70413f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7041328a0 0x7fc70412c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7040b1330 con 0x7fc704068480 2023-09-30T01:56:10.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70414c3d0 con 0x7fc7040680b0 2023-09-30T01:56:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc708da5700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc704148fb0 con 0x7fc7041328a0 2023-09-30T01:56:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc703fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7041328a0 0x7fc70412c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc702ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc704068480 0x7fc70413f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc702ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc704068480 0x7fc70413f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40102/0 (socket says 172.21.15.55:40102) 2023-09-30T01:56:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc703fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7041328a0 0x7fc70412c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43994/0 (socket says 172.21.15.55:43994) 2023-09-30T01:56:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc702ffd700 1 -- 172.21.15.55:0/2060938261 learned_addr learned my addr 172.21.15.55:0/2060938261 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc7037fe700 1 --2- 172.21.15.55:0/2060938261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7040680b0 0x7fc70412b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc703fff700 1 -- 172.21.15.55:0/2060938261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7040680b0 msgr2=0x7fc70412b0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc703fff700 1 --2- 172.21.15.55:0/2060938261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7040680b0 0x7fc70412b0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc703fff700 1 -- 172.21.15.55:0/2060938261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc704068480 msgr2=0x7fc70413f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc703fff700 1 --2- 172.21.15.55:0/2060938261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc704068480 0x7fc70413f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.503+0000 7fc703fff700 1 -- 172.21.15.55:0/2060938261 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f800b590 con 0x7fc7041328a0 2023-09-30T01:56:10.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.507+0000 7fc703fff700 1 --2- 172.21.15.55:0/2060938261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7041328a0 0x7fc70412c360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0101f0 tx=0x7fc6fc00f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.511+0000 7fc6eb7fe700 1 -- 172.21.15.55:0/2060938261 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc01c070 con 0x7fc7041328a0 2023-09-30T01:56:10.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.511+0000 7fc6eb7fe700 1 -- 172.21.15.55:0/2060938261 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc013040 con 0x7fc7041328a0 2023-09-30T01:56:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.511+0000 7fc708da5700 1 -- 172.21.15.55:0/2060938261 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7041402d0 con 0x7fc7041328a0 2023-09-30T01:56:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.511+0000 7fc6eb7fe700 1 -- 172.21.15.55:0/2060938261 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc012020 con 0x7fc7041328a0 2023-09-30T01:56:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.511+0000 7fc708da5700 1 -- 172.21.15.55:0/2060938261 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70412c8a0 con 0x7fc7041328a0 2023-09-30T01:56:10.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.511+0000 7fc708da5700 1 -- 172.21.15.55:0/2060938261 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc704064440 con 0x7fc7041328a0 2023-09-30T01:56:10.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.511+0000 7fc6eb7fe700 1 -- 172.21.15.55:0/2060938261 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc6fc00d2e0 con 0x7fc7041328a0 2023-09-30T01:56:10.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.511+0000 7fc6eb7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:10.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.515+0000 7fc6eb7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:10.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.515+0000 7fc6eb7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:10.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.515+0000 7fc6eb7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:10.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.515+0000 7fc6eb7fe700 1 --2- 172.21.15.55:0/2060938261 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc6f008e980 0x7fc6f0090e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.515+0000 7fc6eb7fe700 1 -- 172.21.15.55:0/2060938261 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fc6fc0b9a00 con 0x7fc7041328a0 2023-09-30T01:56:10.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.515+0000 7fc7037fe700 1 --2- 172.21.15.55:0/2060938261 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc6f008e980 0x7fc6f0090e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.515+0000 7fc7037fe700 1 --2- 172.21.15.55:0/2060938261 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc6f008e980 0x7fc6f0090e30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009d40 tx=0x7fc6f4008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.519+0000 7fc6eb7fe700 1 -- 172.21.15.55:0/2060938261 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc6fc08a430 con 0x7fc7041328a0 2023-09-30T01:56:10.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.611+0000 7fb6abfff700 1 -- 172.21.15.55:0/664870674 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fb6c804b5c0 con 0x7fb6c81418d0 2023-09-30T01:56:10.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.611+0000 7fb6be7fc700 1 -- 172.21.15.55:0/664870674 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb6c4089eb0 con 0x7fb6c81418d0 2023-09-30T01:56:10.617 INFO:teuthology.orchestra.run.smithi055.stdout:38654705670 2023-09-30T01:56:10.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.615+0000 7fb6abfff700 10 mgrc shutdown 2023-09-30T01:56:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.615+0000 7fb6abfff700 1 -- 172.21.15.55:0/664870674 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb6ac08e900 msgr2=0x7fb6ac090db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.615+0000 7fb6abfff700 1 --2- 172.21.15.55:0/664870674 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb6ac08e900 0x7fb6ac090db0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8009db0 tx=0x7fb6b80091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.615+0000 7fb6abfff700 1 -- 172.21.15.55:0/664870674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c81418d0 msgr2=0x7fb6c80b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.615+0000 7fb6abfff700 1 --2- 172.21.15.55:0/664870674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c81418d0 0x7fb6c80b0fb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb6c4016000 tx=0x7fb6c4017000 comp rx=0 tx=0).stop 2023-09-30T01:56:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.615+0000 7fb6abfff700 1 -- 172.21.15.55:0/664870674 shutdown_connections 2023-09-30T01:56:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.615+0000 7fb6abfff700 1 --2- 172.21.15.55:0/664870674 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb6ac08e900 0x7fb6ac090db0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.615+0000 7fb6abfff700 1 --2- 172.21.15.55:0/664870674 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb6c80b14f0 0x7fb6c80af830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.615+0000 7fb6abfff700 1 --2- 172.21.15.55:0/664870674 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb6c81418d0 0x7fb6c80b0fb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.615+0000 7fb6abfff700 1 --2- 172.21.15.55:0/664870674 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb6c806ff20 0x7fb6c813e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.615+0000 7fb6abfff700 1 -- 172.21.15.55:0/664870674 >> 172.21.15.55:0/664870674 conn(0x7fb6c806a610 msgr2=0x7fb6c813f130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:10.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.615+0000 7fb6abfff700 1 -- 172.21.15.55:0/664870674 shutdown_connections 2023-09-30T01:56:10.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.615+0000 7fb6abfff700 1 -- 172.21.15.55:0/664870674 wait complete. 2023-09-30T01:56:10.631 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.0 2023-09-30T01:56:10.631 DEBUG:teuthology.parallel:result is None 2023-09-30T01:56:10.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.647+0000 7feed33df700 1 -- 172.21.15.55:0/473983109 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7feecc1434f0 con 0x7feecc06be70 2023-09-30T01:56:10.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.647+0000 7feec17fa700 1 -- 172.21.15.55:0/473983109 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feec80b9020 con 0x7feecc06be70 2023-09-30T01:56:10.652 INFO:teuthology.orchestra.run.smithi055.stdout:38654705671 2023-09-30T01:56:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.651+0000 7feed33df700 10 mgrc shutdown 2023-09-30T01:56:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.651+0000 7feed33df700 1 -- 172.21.15.55:0/473983109 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7feeb008e8b0 msgr2=0x7feeb0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.651+0000 7feed33df700 1 --2- 172.21.15.55:0/473983109 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7feeb008e8b0 0x7feeb0090d60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feecc1334d0 tx=0x7feebc009040 comp rx=0 tx=0).stop 2023-09-30T01:56:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.651+0000 7feed33df700 1 -- 172.21.15.55:0/473983109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc06be70 msgr2=0x7feecc132d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.651+0000 7feed33df700 1 --2- 172.21.15.55:0/473983109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc06be70 0x7feecc132d30 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7feec800c4e0 tx=0x7feec800c8a0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.651+0000 7feed33df700 1 -- 172.21.15.55:0/473983109 shutdown_connections 2023-09-30T01:56:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.651+0000 7feed33df700 1 --2- 172.21.15.55:0/473983109 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feecc0b3a40 0x7feecc12d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.651+0000 7feed33df700 1 --2- 172.21.15.55:0/473983109 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7feeb008e8b0 0x7feeb0090d60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.651+0000 7feed33df700 1 --2- 172.21.15.55:0/473983109 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feecc0abf10 0x7feecc0ad660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.655 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.651+0000 7feed33df700 1 --2- 172.21.15.55:0/473983109 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feecc06be70 0x7feecc132d30 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.651+0000 7feed33df700 1 -- 172.21.15.55:0/473983109 >> 172.21.15.55:0/473983109 conn(0x7feecc062c70 msgr2=0x7feecc063040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:10.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.651+0000 7feed33df700 1 -- 172.21.15.55:0/473983109 shutdown_connections 2023-09-30T01:56:10.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.651+0000 7feed33df700 1 -- 172.21.15.55:0/473983109 wait complete. 2023-09-30T01:56:10.665 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.3 2023-09-30T01:56:10.665 DEBUG:teuthology.parallel:result is None 2023-09-30T01:56:10.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.671+0000 7fdd5efc7700 1 -- 172.21.15.55:0/2187207229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fdd38005630 con 0x7fdd58140a90 2023-09-30T01:56:10.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.671+0000 7fdd54ff9700 1 -- 172.21.15.55:0/2187207229 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdd50088270 con 0x7fdd58140a90 2023-09-30T01:56:10.677 INFO:teuthology.orchestra.run.smithi055.stdout:38654705671 2023-09-30T01:56:10.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.675+0000 7fdd5efc7700 10 mgrc shutdown 2023-09-30T01:56:10.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.675+0000 7fdd5efc7700 1 -- 172.21.15.55:0/2187207229 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdd4408e8b0 msgr2=0x7fdd44090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.675+0000 7fdd5efc7700 1 --2- 172.21.15.55:0/2187207229 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdd4408e8b0 0x7fdd44090d60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800ba90 tx=0x7fdd48019000 comp rx=0 tx=0).stop 2023-09-30T01:56:10.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.675+0000 7fdd5efc7700 1 -- 172.21.15.55:0/2187207229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd58140a90 msgr2=0x7fdd5812c030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.675+0000 7fdd5efc7700 1 --2- 172.21.15.55:0/2187207229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd58140a90 0x7fdd5812c030 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdd5000b5e0 tx=0x7fdd50009060 comp rx=0 tx=0).stop 2023-09-30T01:56:10.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.675+0000 7fdd5efc7700 1 -- 172.21.15.55:0/2187207229 shutdown_connections 2023-09-30T01:56:10.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.675+0000 7fdd5efc7700 1 --2- 172.21.15.55:0/2187207229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd58140a90 0x7fdd5812c030 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.675+0000 7fdd5efc7700 1 --2- 172.21.15.55:0/2187207229 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdd4408e8b0 0x7fdd44090d60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.675+0000 7fdd5efc7700 1 --2- 172.21.15.55:0/2187207229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd580af610 0x7fdd5813f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.675+0000 7fdd5efc7700 1 --2- 172.21.15.55:0/2187207229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd580a5800 0x7fdd580acda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.675+0000 7fdd5efc7700 1 -- 172.21.15.55:0/2187207229 >> 172.21.15.55:0/2187207229 conn(0x7fdd58063390 msgr2=0x7fdd580af9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:10.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.675+0000 7fdd5efc7700 1 -- 172.21.15.55:0/2187207229 shutdown_connections 2023-09-30T01:56:10.680 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.675+0000 7fdd5efc7700 1 -- 172.21.15.55:0/2187207229 wait complete. 2023-09-30T01:56:10.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.1 2023-09-30T01:56:10.694 DEBUG:teuthology.parallel:result is None 2023-09-30T01:56:10.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.723+0000 7fc708da5700 1 -- 172.21.15.55:0/2060938261 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fc70412b620 con 0x7fc7041328a0 2023-09-30T01:56:10.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.723+0000 7fc6eb7fe700 1 -- 172.21.15.55:0/2060938261 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc6fc08da50 con 0x7fc7041328a0 2023-09-30T01:56:10.728 INFO:teuthology.orchestra.run.smithi055.stdout:38654705672 2023-09-30T01:56:10.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.727+0000 7fc708da5700 10 mgrc shutdown 2023-09-30T01:56:10.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.727+0000 7fc708da5700 1 -- 172.21.15.55:0/2060938261 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc6f008e980 msgr2=0x7fc6f0090e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.727+0000 7fc708da5700 1 --2- 172.21.15.55:0/2060938261 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc6f008e980 0x7fc6f0090e30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4009d40 tx=0x7fc6f4008040 comp rx=0 tx=0).stop 2023-09-30T01:56:10.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.727+0000 7fc708da5700 1 -- 172.21.15.55:0/2060938261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7041328a0 msgr2=0x7fc70412c360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.727+0000 7fc708da5700 1 --2- 172.21.15.55:0/2060938261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7041328a0 0x7fc70412c360 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc0101f0 tx=0x7fc6fc00f040 comp rx=0 tx=0).stop 2023-09-30T01:56:10.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.727+0000 7fc708da5700 1 -- 172.21.15.55:0/2060938261 shutdown_connections 2023-09-30T01:56:10.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.727+0000 7fc708da5700 1 --2- 172.21.15.55:0/2060938261 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc6f008e980 0x7fc6f0090e30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.727+0000 7fc708da5700 1 --2- 172.21.15.55:0/2060938261 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc7041328a0 0x7fc70412c360 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.727+0000 7fc708da5700 1 --2- 172.21.15.55:0/2060938261 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc704068480 0x7fc70413f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.727+0000 7fc708da5700 1 --2- 172.21.15.55:0/2060938261 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc7040680b0 0x7fc70412b0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.727+0000 7fc708da5700 1 -- 172.21.15.55:0/2060938261 >> 172.21.15.55:0/2060938261 conn(0x7fc70406a610 msgr2=0x7fc704130990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:10.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.727+0000 7fc708da5700 1 -- 172.21.15.55:0/2060938261 shutdown_connections 2023-09-30T01:56:10.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.727+0000 7fc708da5700 1 -- 172.21.15.55:0/2060938261 wait complete. 2023-09-30T01:56:10.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705672 got 38654705672 for osd.2 2023-09-30T01:56:10.743 DEBUG:teuthology.parallel:result is None 2023-09-30T01:56:10.743 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-09-30T01:56:10.743 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T01:56:10.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cdf33700 1 Processor -- start 2023-09-30T01:56:10.894 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cdf33700 1 -- start start 2023-09-30T01:56:10.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cdf33700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90c8140b10 0x7f90c80a5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.895 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cdf33700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c80a58d0 con 0x7f90c8145390 2023-09-30T01:56:10.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cdf33700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c80a56d0 con 0x7f90c80affa0 2023-09-30T01:56:10.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cdf33700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c806d830 con 0x7f90c8140b10 2023-09-30T01:56:10.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90ccf31700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f90c8140b10 0x7f90c80a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cd732700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f90c8145390 0x7f90c8147770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53202/0 (socket says 172.21.15.55:53202) 2023-09-30T01:56:10.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cd732700 1 -- 172.21.15.55:0/1194522079 learned_addr learned my addr 172.21.15.55:0/1194522079 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:10.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90c77fe700 1 -- 172.21.15.55:0/1194522079 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085118019 0 0) 0x7f90c80a56d0 con 0x7f90c80affa0 2023-09-30T01:56:10.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90ccf31700 1 -- 172.21.15.55:0/1194522079 >> v1:172.21.15.133:6789/0 conn(0x7f90c80affa0 legacy=0x7f90c806d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90ccf31700 1 -- 172.21.15.55:0/1194522079 >> v1:172.21.15.55:6789/0 conn(0x7f90c8145390 legacy=0x7f90c8147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90ccf31700 1 -- 172.21.15.55:0/1194522079 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c8140180 con 0x7f90c8140b10 2023-09-30T01:56:10.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90ccf31700 1 --2- 172.21.15.55:0/1194522079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90c8140b10 0x7f90c80a5190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f90b00098e0 tx=0x7f90b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6fcc72ddf013840 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90c77fe700 1 -- 172.21.15.55:0/1194522079 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0009e80 con 0x7f90c8140b10 2023-09-30T01:56:10.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90c77fe700 1 -- 172.21.15.55:0/1194522079 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b000b760 con 0x7f90c8140b10 2023-09-30T01:56:10.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90c77fe700 1 -- 172.21.15.55:0/1194522079 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b000bae0 con 0x7f90c8140b10 2023-09-30T01:56:10.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cdf33700 1 -- 172.21.15.55:0/1194522079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90c8140b10 msgr2=0x7f90c80a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cdf33700 1 --2- 172.21.15.55:0/1194522079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90c8140b10 0x7f90c80a5190 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f90b00098e0 tx=0x7f90b00091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cdf33700 1 -- 172.21.15.55:0/1194522079 shutdown_connections 2023-09-30T01:56:10.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cdf33700 1 --2- 172.21.15.55:0/1194522079 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90c8140b10 0x7f90c80a5190 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cdf33700 1 -- 172.21.15.55:0/1194522079 >> 172.21.15.55:0/1194522079 conn(0x7f90c80681b0 msgr2=0x7f90c80685b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:10.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cdf33700 1 -- 172.21.15.55:0/1194522079 shutdown_connections 2023-09-30T01:56:10.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.891+0000 7f90cdf33700 1 -- 172.21.15.55:0/1194522079 wait complete. 2023-09-30T01:56:10.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90cdf33700 1 Processor -- start 2023-09-30T01:56:10.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90cdf33700 1 -- start start 2023-09-30T01:56:10.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90cdf33700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90c80affa0 0x7f90c8142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90cdf33700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90c8140b10 0x7f90c8138100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90cdf33700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c8145390 0x7f90c813a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90cdf33700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c8137ae0 con 0x7f90c80affa0 2023-09-30T01:56:10.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90cdf33700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c8137c70 con 0x7f90c8145390 2023-09-30T01:56:10.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90cdf33700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c8143b00 con 0x7f90c8140b10 2023-09-30T01:56:10.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90ccf31700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90c80affa0 0x7f90c8142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90c7fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90c8140b10 0x7f90c8138100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90ccf31700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90c80affa0 0x7f90c8142d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40110/0 (socket says 172.21.15.55:40110) 2023-09-30T01:56:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90ccf31700 1 -- 172.21.15.55:0/2276799522 learned_addr learned my addr 172.21.15.55:0/2276799522 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90cd732700 1 --2- 172.21.15.55:0/2276799522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c8145390 0x7f90c813a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90ccf31700 1 -- 172.21.15.55:0/2276799522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90c8140b10 msgr2=0x7f90c8138100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90ccf31700 1 --2- 172.21.15.55:0/2276799522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90c8140b10 0x7f90c8138100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90ccf31700 1 -- 172.21.15.55:0/2276799522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c8145390 msgr2=0x7f90c813a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90ccf31700 1 --2- 172.21.15.55:0/2276799522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c8145390 0x7f90c813a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90ccf31700 1 -- 172.21.15.55:0/2276799522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b0009420 con 0x7f90c80affa0 2023-09-30T01:56:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90c7fff700 1 --2- 172.21.15.55:0/2276799522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90c8140b10 0x7f90c8138100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:10.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90ccf31700 1 --2- 172.21.15.55:0/2276799522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90c80affa0 0x7f90c8142d70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90c806a300 tx=0x7f90b0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90c4ff9700 1 -- 172.21.15.55:0/2276799522 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b000bae0 con 0x7f90c80affa0 2023-09-30T01:56:10.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90c4ff9700 1 -- 172.21.15.55:0/2276799522 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b001c460 con 0x7f90c80affa0 2023-09-30T01:56:10.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90cdf33700 1 -- 172.21.15.55:0/2276799522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c813afd0 con 0x7f90c80affa0 2023-09-30T01:56:10.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90cdf33700 1 -- 172.21.15.55:0/2276799522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c80ab530 con 0x7f90c80affa0 2023-09-30T01:56:10.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.895+0000 7f90c4ff9700 1 -- 172.21.15.55:0/2276799522 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b001c7e0 con 0x7f90c80affa0 2023-09-30T01:56:10.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.899+0000 7f90cdf33700 1 -- 172.21.15.55:0/2276799522 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c8064440 con 0x7f90c80affa0 2023-09-30T01:56:10.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.899+0000 7f90c4ff9700 1 -- 172.21.15.55:0/2276799522 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f90b001cb90 con 0x7f90c80affa0 2023-09-30T01:56:10.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.899+0000 7f90c4ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:10.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.903+0000 7f90c4ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:10.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.903+0000 7f90c4ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:10.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.903+0000 7f90c4ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:10.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.903+0000 7f90c4ff9700 1 --2- 172.21.15.55:0/2276799522 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f90a808e830 0x7f90a8090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:10.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.903+0000 7f90c4ff9700 1 -- 172.21.15.55:0/2276799522 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f90b00b6bd0 con 0x7f90c80affa0 2023-09-30T01:56:10.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.903+0000 7f90c7fff700 1 --2- 172.21.15.55:0/2276799522 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f90a808e830 0x7f90a8090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:10.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.903+0000 7f90c7fff700 1 --2- 172.21.15.55:0/2276799522 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f90a808e830 0x7f90a8090ce0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f90c80af250 tx=0x7f90c0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:10.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:10.911+0000 7f90c4ff9700 1 -- 172.21.15.55:0/2276799522 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f90b0087630 con 0x7f90c80affa0 2023-09-30T01:56:11.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.071+0000 7f90cdf33700 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2023-09-30T01:56:11.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.071+0000 7f90cdf33700 1 -- 172.21.15.55:0/2276799522 --> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f90c8137db0 con 0x7f90a808e830 2023-09-30T01:56:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.087+0000 7f90c4ff9700 1 -- 172.21.15.55:0/2276799522 <== mgr.4103 v2:172.21.15.55:6808/27538 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+269322 (secure 0 0 0) 0x7f90c000fce0 con 0x7f90a808e830 2023-09-30T01:56:11.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.087+0000 7f90c4ff9700 20 mgrc handle_command_reply tid 0 r 0 2023-09-30T01:56:11.095 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:11.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.091+0000 7f90cdf33700 10 mgrc shutdown 2023-09-30T01:56:11.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.091+0000 7f90cdf33700 1 -- 172.21.15.55:0/2276799522 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f90a808e830 msgr2=0x7f90a8090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.091+0000 7f90cdf33700 1 --2- 172.21.15.55:0/2276799522 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f90a808e830 0x7f90a8090ce0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f90c80af250 tx=0x7f90c0009040 comp rx=0 tx=0).stop 2023-09-30T01:56:11.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.091+0000 7f90cdf33700 1 -- 172.21.15.55:0/2276799522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90c80affa0 msgr2=0x7f90c8142d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.091+0000 7f90cdf33700 1 --2- 172.21.15.55:0/2276799522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90c80affa0 0x7f90c8142d70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f90c806a300 tx=0x7f90b0016000 comp rx=0 tx=0).stop 2023-09-30T01:56:11.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.091+0000 7f90cdf33700 1 -- 172.21.15.55:0/2276799522 shutdown_connections 2023-09-30T01:56:11.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.091+0000 7f90cdf33700 1 --2- 172.21.15.55:0/2276799522 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f90c8145390 0x7f90c813a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.091+0000 7f90cdf33700 1 --2- 172.21.15.55:0/2276799522 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f90a808e830 0x7f90a8090ce0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.091+0000 7f90cdf33700 1 --2- 172.21.15.55:0/2276799522 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f90c8140b10 0x7f90c8138100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.091+0000 7f90cdf33700 1 --2- 172.21.15.55:0/2276799522 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f90c80affa0 0x7f90c8142d70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.091+0000 7f90cdf33700 1 -- 172.21.15.55:0/2276799522 >> 172.21.15.55:0/2276799522 conn(0x7f90c80681b0 msgr2=0x7f90c8144bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:11.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.091+0000 7f90cdf33700 1 -- 172.21.15.55:0/2276799522 shutdown_connections 2023-09-30T01:56:11.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.095+0000 7f90cdf33700 1 -- 172.21.15.55:0/2276799522 wait complete. 2023-09-30T01:56:11.099 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-09-30T01:56:11.111 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-09-30T01:56:11.032994+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":38608,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":36672,"kb_avail":377448752,"statfs":{"total":386547056640,"available":386507522048,"internally_reserved":0,"allocated":1949696,"data_stored":1425218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37552128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.004006"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145491+0000","last_change":"2023-09-30T01:56:00.139640+0000","last_active":"2023-09-30T01:56:00.145491+0000","last_peered":"2023-09-30T01:56:00.145491+0000","last_clean":"2023-09-30T01:56:00.145491+0000","last_became_active":"2023-09-30T01:56:00.139371+0000","last_became_peered":"2023-09-30T01:56:00.139371+0000","last_unstale":"2023-09-30T01:56:00.145491+0000","last_undegraded":"2023-09-30T01:56:00.145491+0000","last_fullsized":"2023-09-30T01:56:00.145491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:24:15.189346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150056+0000","last_change":"2023-09-30T01:56:00.148833+0000","last_active":"2023-09-30T01:56:00.150056+0000","last_peered":"2023-09-30T01:56:00.150056+0000","last_clean":"2023-09-30T01:56:00.150056+0000","last_became_active":"2023-09-30T01:56:00.148030+0000","last_became_peered":"2023-09-30T01:56:00.148030+0000","last_unstale":"2023-09-30T01:56:00.150056+0000","last_undegraded":"2023-09-30T01:56:00.150056+0000","last_fullsized":"2023-09-30T01:56:00.150056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:32:23.254275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150085+0000","last_change":"2023-09-30T01:56:00.148504+0000","last_active":"2023-09-30T01:56:00.150085+0000","last_peered":"2023-09-30T01:56:00.150085+0000","last_clean":"2023-09-30T01:56:00.150085+0000","last_became_active":"2023-09-30T01:56:00.148039+0000","last_became_peered":"2023-09-30T01:56:00.148039+0000","last_unstale":"2023-09-30T01:56:00.150085+0000","last_undegraded":"2023-09-30T01:56:00.150085+0000","last_fullsized":"2023-09-30T01:56:00.150085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:30:20.150172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155598+0000","last_change":"2023-09-30T01:56:00.148000+0000","last_active":"2023-09-30T01:56:00.155598+0000","last_peered":"2023-09-30T01:56:00.155598+0000","last_clean":"2023-09-30T01:56:00.155598+0000","last_became_active":"2023-09-30T01:56:00.147578+0000","last_became_peered":"2023-09-30T01:56:00.147578+0000","last_unstale":"2023-09-30T01:56:00.155598+0000","last_undegraded":"2023-09-30T01:56:00.155598+0000","last_fullsized":"2023-09-30T01:56:00.155598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:04.461529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.149753+0000","last_change":"2023-09-30T01:56:00.145999+0000","last_active":"2023-09-30T01:56:00.149753+0000","last_peered":"2023-09-30T01:56:00.149753+0000","last_clean":"2023-09-30T01:56:00.149753+0000","last_became_active":"2023-09-30T01:56:00.145352+0000","last_became_peered":"2023-09-30T01:56:00.145352+0000","last_unstale":"2023-09-30T01:56:00.149753+0000","last_undegraded":"2023-09-30T01:56:00.149753+0000","last_fullsized":"2023-09-30T01:56:00.149753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:31:18.857698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148578+0000","last_change":"2023-09-30T01:56:00.143060+0000","last_active":"2023-09-30T01:56:00.148578+0000","last_peered":"2023-09-30T01:56:00.148578+0000","last_clean":"2023-09-30T01:56:00.148578+0000","last_became_active":"2023-09-30T01:56:00.142616+0000","last_became_peered":"2023-09-30T01:56:00.142616+0000","last_unstale":"2023-09-30T01:56:00.148578+0000","last_undegraded":"2023-09-30T01:56:00.148578+0000","last_fullsized":"2023-09-30T01:56:00.148578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:41:29.282659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148779+0000","last_change":"2023-09-30T01:56:00.143260+0000","last_active":"2023-09-30T01:56:00.148779+0000","last_peered":"2023-09-30T01:56:00.148779+0000","last_clean":"2023-09-30T01:56:00.148779+0000","last_became_active":"2023-09-30T01:56:00.142575+0000","last_became_peered":"2023-09-30T01:56:00.142575+0000","last_unstale":"2023-09-30T01:56:00.148779+0000","last_undegraded":"2023-09-30T01:56:00.148779+0000","last_fullsized":"2023-09-30T01:56:00.148779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:37.790754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143024+0000","last_change":"2023-09-30T01:56:00.137083+0000","last_active":"2023-09-30T01:56:00.143024+0000","last_peered":"2023-09-30T01:56:00.143024+0000","last_clean":"2023-09-30T01:56:00.143024+0000","last_became_active":"2023-09-30T01:56:00.136730+0000","last_became_peered":"2023-09-30T01:56:00.136730+0000","last_unstale":"2023-09-30T01:56:00.143024+0000","last_undegraded":"2023-09-30T01:56:00.143024+0000","last_fullsized":"2023-09-30T01:56:00.143024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:04.461529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145712+0000","last_change":"2023-09-30T01:56:00.141053+0000","last_active":"2023-09-30T01:56:00.145712+0000","last_peered":"2023-09-30T01:56:00.145712+0000","last_clean":"2023-09-30T01:56:00.145712+0000","last_became_active":"2023-09-30T01:56:00.140018+0000","last_became_peered":"2023-09-30T01:56:00.140018+0000","last_unstale":"2023-09-30T01:56:00.145712+0000","last_undegraded":"2023-09-30T01:56:00.145712+0000","last_fullsized":"2023-09-30T01:56:00.145712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:14:33.172803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.152909+0000","last_change":"2023-09-30T01:56:00.146386+0000","last_active":"2023-09-30T01:56:00.152909+0000","last_peered":"2023-09-30T01:56:00.152909+0000","last_clean":"2023-09-30T01:56:00.152909+0000","last_became_active":"2023-09-30T01:56:00.146117+0000","last_became_peered":"2023-09-30T01:56:00.146117+0000","last_unstale":"2023-09-30T01:56:00.152909+0000","last_undegraded":"2023-09-30T01:56:00.152909+0000","last_fullsized":"2023-09-30T01:56:00.152909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:55:44.330139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155662+0000","last_change":"2023-09-30T01:56:00.150324+0000","last_active":"2023-09-30T01:56:00.155662+0000","last_peered":"2023-09-30T01:56:00.155662+0000","last_clean":"2023-09-30T01:56:00.155662+0000","last_became_active":"2023-09-30T01:56:00.150121+0000","last_became_peered":"2023-09-30T01:56:00.150121+0000","last_unstale":"2023-09-30T01:56:00.155662+0000","last_undegraded":"2023-09-30T01:56:00.155662+0000","last_fullsized":"2023-09-30T01:56:00.155662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:37:10.888007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145198+0000","last_change":"2023-09-30T01:56:00.135304+0000","last_active":"2023-09-30T01:56:00.145198+0000","last_peered":"2023-09-30T01:56:00.145198+0000","last_clean":"2023-09-30T01:56:00.145198+0000","last_became_active":"2023-09-30T01:56:00.134990+0000","last_became_peered":"2023-09-30T01:56:00.134990+0000","last_unstale":"2023-09-30T01:56:00.145198+0000","last_undegraded":"2023-09-30T01:56:00.145198+0000","last_fullsized":"2023-09-30T01:56:00.145198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:26:31.604340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145469+0000","last_change":"2023-09-30T01:56:00.139589+0000","last_active":"2023-09-30T01:56:00.145469+0000","last_peered":"2023-09-30T01:56:00.145469+0000","last_clean":"2023-09-30T01:56:00.145469+0000","last_became_active":"2023-09-30T01:56:00.139313+0000","last_became_peered":"2023-09-30T01:56:00.139313+0000","last_unstale":"2023-09-30T01:56:00.145469+0000","last_undegraded":"2023-09-30T01:56:00.145469+0000","last_fullsized":"2023-09-30T01:56:00.145469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:20.598891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143004+0000","last_change":"2023-09-30T01:56:00.136514+0000","last_active":"2023-09-30T01:56:00.143004+0000","last_peered":"2023-09-30T01:56:00.143004+0000","last_clean":"2023-09-30T01:56:00.143004+0000","last_became_active":"2023-09-30T01:56:00.136143+0000","last_became_peered":"2023-09-30T01:56:00.136143+0000","last_unstale":"2023-09-30T01:56:00.143004+0000","last_undegraded":"2023-09-30T01:56:00.143004+0000","last_fullsized":"2023-09-30T01:56:00.143004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:27:08.978174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142786+0000","last_change":"2023-09-30T01:56:00.135556+0000","last_active":"2023-09-30T01:56:00.142786+0000","last_peered":"2023-09-30T01:56:00.142786+0000","last_clean":"2023-09-30T01:56:00.142786+0000","last_became_active":"2023-09-30T01:56:00.135247+0000","last_became_peered":"2023-09-30T01:56:00.135247+0000","last_unstale":"2023-09-30T01:56:00.142786+0000","last_undegraded":"2023-09-30T01:56:00.142786+0000","last_fullsized":"2023-09-30T01:56:00.142786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:55:44.330139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143006+0000","last_change":"2023-09-30T01:56:00.136819+0000","last_active":"2023-09-30T01:56:00.143006+0000","last_peered":"2023-09-30T01:56:00.143006+0000","last_clean":"2023-09-30T01:56:00.143006+0000","last_became_active":"2023-09-30T01:56:00.136318+0000","last_became_peered":"2023-09-30T01:56:00.136318+0000","last_unstale":"2023-09-30T01:56:00.143006+0000","last_undegraded":"2023-09-30T01:56:00.143006+0000","last_fullsized":"2023-09-30T01:56:00.143006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:37:10.888007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.138731+0000","last_change":"2023-09-30T01:56:00.132691+0000","last_active":"2023-09-30T01:56:00.138731+0000","last_peered":"2023-09-30T01:56:00.138731+0000","last_clean":"2023-09-30T01:56:00.138731+0000","last_became_active":"2023-09-30T01:56:00.132457+0000","last_became_peered":"2023-09-30T01:56:00.132457+0000","last_unstale":"2023-09-30T01:56:00.138731+0000","last_undegraded":"2023-09-30T01:56:00.138731+0000","last_fullsized":"2023-09-30T01:56:00.138731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:31:18.857698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148808+0000","last_change":"2023-09-30T01:56:00.145655+0000","last_active":"2023-09-30T01:56:00.148808+0000","last_peered":"2023-09-30T01:56:00.148808+0000","last_clean":"2023-09-30T01:56:00.148808+0000","last_became_active":"2023-09-30T01:56:00.145375+0000","last_became_peered":"2023-09-30T01:56:00.145375+0000","last_unstale":"2023-09-30T01:56:00.148808+0000","last_undegraded":"2023-09-30T01:56:00.148808+0000","last_fullsized":"2023-09-30T01:56:00.148808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:31.249335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145423+0000","last_change":"2023-09-30T01:56:00.138951+0000","last_active":"2023-09-30T01:56:00.145423+0000","last_peered":"2023-09-30T01:56:00.145423+0000","last_clean":"2023-09-30T01:56:00.145423+0000","last_became_active":"2023-09-30T01:56:00.138624+0000","last_became_peered":"2023-09-30T01:56:00.138624+0000","last_unstale":"2023-09-30T01:56:00.145423+0000","last_undegraded":"2023-09-30T01:56:00.145423+0000","last_fullsized":"2023-09-30T01:56:00.145423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:06:01.640504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155882+0000","last_change":"2023-09-30T01:56:00.150510+0000","last_active":"2023-09-30T01:56:00.155882+0000","last_peered":"2023-09-30T01:56:00.155882+0000","last_clean":"2023-09-30T01:56:00.155882+0000","last_became_active":"2023-09-30T01:56:00.150173+0000","last_became_peered":"2023-09-30T01:56:00.150173+0000","last_unstale":"2023-09-30T01:56:00.155882+0000","last_undegraded":"2023-09-30T01:56:00.155882+0000","last_fullsized":"2023-09-30T01:56:00.155882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:41:29.282659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143136+0000","last_change":"2023-09-30T01:56:00.138339+0000","last_active":"2023-09-30T01:56:00.143136+0000","last_peered":"2023-09-30T01:56:00.143136+0000","last_clean":"2023-09-30T01:56:00.143136+0000","last_became_active":"2023-09-30T01:56:00.138000+0000","last_became_peered":"2023-09-30T01:56:00.138000+0000","last_unstale":"2023-09-30T01:56:00.143136+0000","last_undegraded":"2023-09-30T01:56:00.143136+0000","last_fullsized":"2023-09-30T01:56:00.143136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:50:54.628959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157391+0000","last_change":"2023-09-30T01:56:00.152748+0000","last_active":"2023-09-30T01:56:00.157391+0000","last_peered":"2023-09-30T01:56:00.157391+0000","last_clean":"2023-09-30T01:56:00.157391+0000","last_became_active":"2023-09-30T01:56:00.152435+0000","last_became_peered":"2023-09-30T01:56:00.152435+0000","last_unstale":"2023-09-30T01:56:00.157391+0000","last_undegraded":"2023-09-30T01:56:00.157391+0000","last_fullsized":"2023-09-30T01:56:00.157391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:08.611396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150804+0000","last_change":"2023-09-30T01:56:00.148868+0000","last_active":"2023-09-30T01:56:00.150804+0000","last_peered":"2023-09-30T01:56:00.150804+0000","last_clean":"2023-09-30T01:56:00.150804+0000","last_became_active":"2023-09-30T01:56:00.148611+0000","last_became_peered":"2023-09-30T01:56:00.148611+0000","last_unstale":"2023-09-30T01:56:00.150804+0000","last_undegraded":"2023-09-30T01:56:00.150804+0000","last_fullsized":"2023-09-30T01:56:00.150804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:20:12.451240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143087+0000","last_change":"2023-09-30T01:56:00.137850+0000","last_active":"2023-09-30T01:56:00.143087+0000","last_peered":"2023-09-30T01:56:00.143087+0000","last_clean":"2023-09-30T01:56:00.143087+0000","last_became_active":"2023-09-30T01:56:00.137521+0000","last_became_peered":"2023-09-30T01:56:00.137521+0000","last_unstale":"2023-09-30T01:56:00.143087+0000","last_undegraded":"2023-09-30T01:56:00.143087+0000","last_fullsized":"2023-09-30T01:56:00.143087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:12:45.050840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155855+0000","last_change":"2023-09-30T01:56:00.152024+0000","last_active":"2023-09-30T01:56:00.155855+0000","last_peered":"2023-09-30T01:56:00.155855+0000","last_clean":"2023-09-30T01:56:00.155855+0000","last_became_active":"2023-09-30T01:56:00.150705+0000","last_became_peered":"2023-09-30T01:56:00.150705+0000","last_unstale":"2023-09-30T01:56:00.155855+0000","last_undegraded":"2023-09-30T01:56:00.155855+0000","last_fullsized":"2023-09-30T01:56:00.155855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:27:08.978174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.149819+0000","last_change":"2023-09-30T01:56:00.135734+0000","last_active":"2023-09-30T01:56:00.149819+0000","last_peered":"2023-09-30T01:56:00.149819+0000","last_clean":"2023-09-30T01:56:00.149819+0000","last_became_active":"2023-09-30T01:56:00.134747+0000","last_became_peered":"2023-09-30T01:56:00.134747+0000","last_unstale":"2023-09-30T01:56:00.149819+0000","last_undegraded":"2023-09-30T01:56:00.149819+0000","last_fullsized":"2023-09-30T01:56:00.149819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:10:11.219000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143114+0000","last_change":"2023-09-30T01:56:00.138167+0000","last_active":"2023-09-30T01:56:00.143114+0000","last_peered":"2023-09-30T01:56:00.143114+0000","last_clean":"2023-09-30T01:56:00.143114+0000","last_became_active":"2023-09-30T01:56:00.137821+0000","last_became_peered":"2023-09-30T01:56:00.137821+0000","last_unstale":"2023-09-30T01:56:00.143114+0000","last_undegraded":"2023-09-30T01:56:00.143114+0000","last_fullsized":"2023-09-30T01:56:00.143114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:11:10.730984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150406+0000","last_change":"2023-09-30T01:56:00.138769+0000","last_active":"2023-09-30T01:56:00.150406+0000","last_peered":"2023-09-30T01:56:00.150406+0000","last_clean":"2023-09-30T01:56:00.150406+0000","last_became_active":"2023-09-30T01:56:00.138302+0000","last_became_peered":"2023-09-30T01:56:00.138302+0000","last_unstale":"2023-09-30T01:56:00.150406+0000","last_undegraded":"2023-09-30T01:56:00.150406+0000","last_fullsized":"2023-09-30T01:56:00.150406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:31.820081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148717+0000","last_change":"2023-09-30T01:56:00.145007+0000","last_active":"2023-09-30T01:56:00.148717+0000","last_peered":"2023-09-30T01:56:00.148717+0000","last_clean":"2023-09-30T01:56:00.148717+0000","last_became_active":"2023-09-30T01:56:00.144721+0000","last_became_peered":"2023-09-30T01:56:00.144721+0000","last_unstale":"2023-09-30T01:56:00.148717+0000","last_undegraded":"2023-09-30T01:56:00.148717+0000","last_fullsized":"2023-09-30T01:56:00.148717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:27:08.978174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155951+0000","last_change":"2023-09-30T01:56:00.152139+0000","last_active":"2023-09-30T01:56:00.155951+0000","last_peered":"2023-09-30T01:56:00.155951+0000","last_clean":"2023-09-30T01:56:00.155951+0000","last_became_active":"2023-09-30T01:56:00.150862+0000","last_became_peered":"2023-09-30T01:56:00.150862+0000","last_unstale":"2023-09-30T01:56:00.155951+0000","last_undegraded":"2023-09-30T01:56:00.155951+0000","last_fullsized":"2023-09-30T01:56:00.155951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:42.194028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157422+0000","last_change":"2023-09-30T01:56:00.154368+0000","last_active":"2023-09-30T01:56:00.157422+0000","last_peered":"2023-09-30T01:56:00.157422+0000","last_clean":"2023-09-30T01:56:00.157422+0000","last_became_active":"2023-09-30T01:56:00.153986+0000","last_became_peered":"2023-09-30T01:56:00.153986+0000","last_unstale":"2023-09-30T01:56:00.157422+0000","last_undegraded":"2023-09-30T01:56:00.157422+0000","last_fullsized":"2023-09-30T01:56:00.157422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:51:06.725801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142974+0000","last_change":"2023-09-30T01:56:00.136648+0000","last_active":"2023-09-30T01:56:00.142974+0000","last_peered":"2023-09-30T01:56:00.142974+0000","last_clean":"2023-09-30T01:56:00.142974+0000","last_became_active":"2023-09-30T01:56:00.136284+0000","last_became_peered":"2023-09-30T01:56:00.136284+0000","last_unstale":"2023-09-30T01:56:00.142974+0000","last_undegraded":"2023-09-30T01:56:00.142974+0000","last_fullsized":"2023-09-30T01:56:00.142974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:37.790754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157601+0000","last_change":"2023-09-30T01:56:00.154844+0000","last_active":"2023-09-30T01:56:00.157601+0000","last_peered":"2023-09-30T01:56:00.157601+0000","last_clean":"2023-09-30T01:56:00.157601+0000","last_became_active":"2023-09-30T01:56:00.154532+0000","last_became_peered":"2023-09-30T01:56:00.154532+0000","last_unstale":"2023-09-30T01:56:00.157601+0000","last_undegraded":"2023-09-30T01:56:00.157601+0000","last_fullsized":"2023-09-30T01:56:00.157601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:16:34.209458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.144813+0000","last_change":"2023-09-30T01:55:59.785778+0000","last_active":"2023-09-30T01:56:00.144813+0000","last_peered":"2023-09-30T01:56:00.144813+0000","last_clean":"2023-09-30T01:56:00.144813+0000","last_became_active":"2023-09-30T01:55:59.785425+0000","last_became_peered":"2023-09-30T01:55:59.785425+0000","last_unstale":"2023-09-30T01:56:00.144813+0000","last_undegraded":"2023-09-30T01:56:00.144813+0000","last_fullsized":"2023-09-30T01:56:00.144813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:27:45.755265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148718+0000","last_change":"2023-09-30T01:56:00.144232+0000","last_active":"2023-09-30T01:56:00.148718+0000","last_peered":"2023-09-30T01:56:00.148718+0000","last_clean":"2023-09-30T01:56:00.148718+0000","last_became_active":"2023-09-30T01:56:00.143962+0000","last_became_peered":"2023-09-30T01:56:00.143962+0000","last_unstale":"2023-09-30T01:56:00.148718+0000","last_undegraded":"2023-09-30T01:56:00.148718+0000","last_fullsized":"2023-09-30T01:56:00.148718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:02:54.801532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.114192+0000","last_change":"2023-09-30T01:55:59.782826+0000","last_active":"2023-09-30T01:56:00.114192+0000","last_peered":"2023-09-30T01:56:00.114192+0000","last_clean":"2023-09-30T01:56:00.114192+0000","last_became_active":"2023-09-30T01:55:59.781535+0000","last_became_peered":"2023-09-30T01:55:59.781535+0000","last_unstale":"2023-09-30T01:56:00.114192+0000","last_undegraded":"2023-09-30T01:56:00.114192+0000","last_fullsized":"2023-09-30T01:56:00.114192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:18:41.601447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157568+0000","last_change":"2023-09-30T01:56:00.154810+0000","last_active":"2023-09-30T01:56:00.157568+0000","last_peered":"2023-09-30T01:56:00.157568+0000","last_clean":"2023-09-30T01:56:00.157568+0000","last_became_active":"2023-09-30T01:56:00.154365+0000","last_became_peered":"2023-09-30T01:56:00.154365+0000","last_unstale":"2023-09-30T01:56:00.157568+0000","last_undegraded":"2023-09-30T01:56:00.157568+0000","last_fullsized":"2023-09-30T01:56:00.157568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:51:49.277142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127014+0000","last_change":"2023-09-30T01:55:59.787364+0000","last_active":"2023-09-30T01:56:00.127014+0000","last_peered":"2023-09-30T01:56:00.127014+0000","last_clean":"2023-09-30T01:56:00.127014+0000","last_became_active":"2023-09-30T01:55:59.786992+0000","last_became_peered":"2023-09-30T01:55:59.786992+0000","last_unstale":"2023-09-30T01:56:00.127014+0000","last_undegraded":"2023-09-30T01:56:00.127014+0000","last_fullsized":"2023-09-30T01:56:00.127014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:58:52.492307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157531+0000","last_change":"2023-09-30T01:56:00.154700+0000","last_active":"2023-09-30T01:56:00.157531+0000","last_peered":"2023-09-30T01:56:00.157531+0000","last_clean":"2023-09-30T01:56:00.157531+0000","last_became_active":"2023-09-30T01:56:00.154367+0000","last_became_peered":"2023-09-30T01:56:00.154367+0000","last_unstale":"2023-09-30T01:56:00.157531+0000","last_undegraded":"2023-09-30T01:56:00.157531+0000","last_fullsized":"2023-09-30T01:56:00.157531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:43.999938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.154011+0000","last_change":"2023-09-30T01:55:59.781281+0000","last_active":"2023-09-30T01:56:00.154011+0000","last_peered":"2023-09-30T01:56:00.154011+0000","last_clean":"2023-09-30T01:56:00.154011+0000","last_became_active":"2023-09-30T01:55:59.780907+0000","last_became_peered":"2023-09-30T01:55:59.780907+0000","last_unstale":"2023-09-30T01:56:00.154011+0000","last_undegraded":"2023-09-30T01:56:00.154011+0000","last_fullsized":"2023-09-30T01:56:00.154011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:54.314374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148023+0000","last_change":"2023-09-30T01:55:59.777405+0000","last_active":"2023-09-30T01:56:00.148023+0000","last_peered":"2023-09-30T01:56:00.148023+0000","last_clean":"2023-09-30T01:56:00.148023+0000","last_became_active":"2023-09-30T01:55:59.777101+0000","last_became_peered":"2023-09-30T01:55:59.777101+0000","last_unstale":"2023-09-30T01:56:00.148023+0000","last_undegraded":"2023-09-30T01:56:00.148023+0000","last_fullsized":"2023-09-30T01:56:00.148023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:14:32.159800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148667+0000","last_change":"2023-09-30T01:56:00.143954+0000","last_active":"2023-09-30T01:56:00.148667+0000","last_peered":"2023-09-30T01:56:00.148667+0000","last_clean":"2023-09-30T01:56:00.148667+0000","last_became_active":"2023-09-30T01:56:00.143607+0000","last_became_peered":"2023-09-30T01:56:00.143607+0000","last_unstale":"2023-09-30T01:56:00.148667+0000","last_undegraded":"2023-09-30T01:56:00.148667+0000","last_fullsized":"2023-09-30T01:56:00.148667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:08.611396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142086+0000","last_change":"2023-09-30T01:55:59.772042+0000","last_active":"2023-09-30T01:56:00.142086+0000","last_peered":"2023-09-30T01:56:00.142086+0000","last_clean":"2023-09-30T01:56:00.142086+0000","last_became_active":"2023-09-30T01:55:59.771218+0000","last_became_peered":"2023-09-30T01:55:59.771218+0000","last_unstale":"2023-09-30T01:56:00.142086+0000","last_undegraded":"2023-09-30T01:56:00.142086+0000","last_fullsized":"2023-09-30T01:56:00.142086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:58:12.527512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.153264+0000","last_change":"2023-09-30T01:56:00.146609+0000","last_active":"2023-09-30T01:56:00.153264+0000","last_peered":"2023-09-30T01:56:00.153264+0000","last_clean":"2023-09-30T01:56:00.153264+0000","last_became_active":"2023-09-30T01:56:00.146051+0000","last_became_peered":"2023-09-30T01:56:00.146051+0000","last_unstale":"2023-09-30T01:56:00.153264+0000","last_undegraded":"2023-09-30T01:56:00.153264+0000","last_fullsized":"2023-09-30T01:56:00.153264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:29:29.479636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.144756+0000","last_change":"2023-09-30T01:55:59.787370+0000","last_active":"2023-09-30T01:56:00.144756+0000","last_peered":"2023-09-30T01:56:00.144756+0000","last_clean":"2023-09-30T01:56:00.144756+0000","last_became_active":"2023-09-30T01:55:59.787002+0000","last_became_peered":"2023-09-30T01:55:59.787002+0000","last_unstale":"2023-09-30T01:56:00.144756+0000","last_undegraded":"2023-09-30T01:56:00.144756+0000","last_fullsized":"2023-09-30T01:56:00.144756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:49.528387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143061+0000","last_change":"2023-09-30T01:56:00.137829+0000","last_active":"2023-09-30T01:56:00.143061+0000","last_peered":"2023-09-30T01:56:00.143061+0000","last_clean":"2023-09-30T01:56:00.143061+0000","last_became_active":"2023-09-30T01:56:00.137459+0000","last_became_peered":"2023-09-30T01:56:00.137459+0000","last_unstale":"2023-09-30T01:56:00.143061+0000","last_undegraded":"2023-09-30T01:56:00.143061+0000","last_fullsized":"2023-09-30T01:56:00.143061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:10:44.425502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.131081+0000","last_change":"2023-09-30T01:55:59.783420+0000","last_active":"2023-09-30T01:56:00.131081+0000","last_peered":"2023-09-30T01:56:00.131081+0000","last_clean":"2023-09-30T01:56:00.131081+0000","last_became_active":"2023-09-30T01:55:59.783204+0000","last_became_peered":"2023-09-30T01:55:59.783204+0000","last_unstale":"2023-09-30T01:56:00.131081+0000","last_undegraded":"2023-09-30T01:56:00.131081+0000","last_fullsized":"2023-09-30T01:56:00.131081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:24:14.176343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145005+0000","last_change":"2023-09-30T01:56:00.134933+0000","last_active":"2023-09-30T01:56:00.145005+0000","last_peered":"2023-09-30T01:56:00.145005+0000","last_clean":"2023-09-30T01:56:00.145005+0000","last_became_active":"2023-09-30T01:56:00.134644+0000","last_became_peered":"2023-09-30T01:56:00.134644+0000","last_unstale":"2023-09-30T01:56:00.145005+0000","last_undegraded":"2023-09-30T01:56:00.145005+0000","last_fullsized":"2023-09-30T01:56:00.145005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:23.066981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.154766+0000","last_change":"2023-09-30T01:55:59.784616+0000","last_active":"2023-09-30T01:56:00.154766+0000","last_peered":"2023-09-30T01:56:00.154766+0000","last_clean":"2023-09-30T01:56:00.154766+0000","last_became_active":"2023-09-30T01:55:59.782834+0000","last_became_peered":"2023-09-30T01:55:59.782834+0000","last_unstale":"2023-09-30T01:56:00.154766+0000","last_undegraded":"2023-09-30T01:56:00.154766+0000","last_fullsized":"2023-09-30T01:56:00.154766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:51:07.989623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.152818+0000","last_change":"2023-09-30T01:56:00.145655+0000","last_active":"2023-09-30T01:56:00.152818+0000","last_peered":"2023-09-30T01:56:00.152818+0000","last_clean":"2023-09-30T01:56:00.152818+0000","last_became_active":"2023-09-30T01:56:00.145040+0000","last_became_peered":"2023-09-30T01:56:00.145040+0000","last_unstale":"2023-09-30T01:56:00.152818+0000","last_undegraded":"2023-09-30T01:56:00.152818+0000","last_fullsized":"2023-09-30T01:56:00.152818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:51:49.277142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127154+0000","last_change":"2023-09-30T01:55:59.777347+0000","last_active":"2023-09-30T01:56:00.127154+0000","last_peered":"2023-09-30T01:56:00.127154+0000","last_clean":"2023-09-30T01:56:00.127154+0000","last_became_active":"2023-09-30T01:55:59.777030+0000","last_became_peered":"2023-09-30T01:55:59.777030+0000","last_unstale":"2023-09-30T01:56:00.127154+0000","last_undegraded":"2023-09-30T01:56:00.127154+0000","last_fullsized":"2023-09-30T01:56:00.127154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:19.585888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142984+0000","last_change":"2023-09-30T01:56:00.136790+0000","last_active":"2023-09-30T01:56:00.142984+0000","last_peered":"2023-09-30T01:56:00.142984+0000","last_clean":"2023-09-30T01:56:00.142984+0000","last_became_active":"2023-09-30T01:56:00.136433+0000","last_became_peered":"2023-09-30T01:56:00.136433+0000","last_unstale":"2023-09-30T01:56:00.142984+0000","last_undegraded":"2023-09-30T01:56:00.142984+0000","last_fullsized":"2023-09-30T01:56:00.142984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:08.611396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129426+0000","last_change":"2023-09-30T01:55:59.782594+0000","last_active":"2023-09-30T01:56:00.129426+0000","last_peered":"2023-09-30T01:56:00.129426+0000","last_clean":"2023-09-30T01:56:00.129426+0000","last_became_active":"2023-09-30T01:55:59.782293+0000","last_became_peered":"2023-09-30T01:55:59.782293+0000","last_unstale":"2023-09-30T01:56:00.129426+0000","last_undegraded":"2023-09-30T01:56:00.129426+0000","last_fullsized":"2023-09-30T01:56:00.129426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:17:29.530403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.134113+0000","last_change":"2023-09-30T01:56:00.126377+0000","last_active":"2023-09-30T01:56:00.134113+0000","last_peered":"2023-09-30T01:56:00.134113+0000","last_clean":"2023-09-30T01:56:00.134113+0000","last_became_active":"2023-09-30T01:56:00.125998+0000","last_became_peered":"2023-09-30T01:56:00.125998+0000","last_unstale":"2023-09-30T01:56:00.134113+0000","last_undegraded":"2023-09-30T01:56:00.134113+0000","last_fullsized":"2023-09-30T01:56:00.134113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:58:13.540515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.130011+0000","last_change":"2023-09-30T01:55:59.783826+0000","last_active":"2023-09-30T01:56:00.130011+0000","last_peered":"2023-09-30T01:56:00.130011+0000","last_clean":"2023-09-30T01:56:00.130011+0000","last_became_active":"2023-09-30T01:55:59.783255+0000","last_became_peered":"2023-09-30T01:55:59.783255+0000","last_unstale":"2023-09-30T01:56:00.130011+0000","last_undegraded":"2023-09-30T01:56:00.130011+0000","last_fullsized":"2023-09-30T01:56:00.130011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:39.893506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155612+0000","last_change":"2023-09-30T01:56:00.149604+0000","last_active":"2023-09-30T01:56:00.155612+0000","last_peered":"2023-09-30T01:56:00.155612+0000","last_clean":"2023-09-30T01:56:00.155612+0000","last_became_active":"2023-09-30T01:56:00.147427+0000","last_became_peered":"2023-09-30T01:56:00.147427+0000","last_unstale":"2023-09-30T01:56:00.155612+0000","last_undegraded":"2023-09-30T01:56:00.155612+0000","last_fullsized":"2023-09-30T01:56:00.155612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:30:20.150172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":165,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.121950+0000","last_change":"2023-09-30T01:55:50.454189+0000","last_active":"2023-09-30T01:56:00.121950+0000","last_peered":"2023-09-30T01:56:00.121950+0000","last_clean":"2023-09-30T01:56:00.121950+0000","last_became_active":"2023-09-30T01:55:50.451349+0000","last_became_peered":"2023-09-30T01:55:50.451349+0000","last_unstale":"2023-09-30T01:56:00.121950+0000","last_undegraded":"2023-09-30T01:56:00.121950+0000","last_fullsized":"2023-09-30T01:56:00.121950+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:49.223709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:49.223709+0000","last_clean_scrub_stamp":"2023-09-30T01:55:49.223709+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:14:10.620817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127411+0000","last_change":"2023-09-30T01:55:55.596984+0000","last_active":"2023-09-30T01:56:00.127411+0000","last_peered":"2023-09-30T01:56:00.127411+0000","last_clean":"2023-09-30T01:56:00.127411+0000","last_became_active":"2023-09-30T01:55:55.596422+0000","last_became_peered":"2023-09-30T01:55:55.596422+0000","last_unstale":"2023-09-30T01:56:00.127411+0000","last_undegraded":"2023-09-30T01:56:00.127411+0000","last_fullsized":"2023-09-30T01:56:00.127411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:25.143805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.128684+0000","last_change":"2023-09-30T01:55:59.783410+0000","last_active":"2023-09-30T01:56:00.128684+0000","last_peered":"2023-09-30T01:56:00.128684+0000","last_clean":"2023-09-30T01:56:00.128684+0000","last_became_active":"2023-09-30T01:55:59.783095+0000","last_became_peered":"2023-09-30T01:55:59.783095+0000","last_unstale":"2023-09-30T01:56:00.128684+0000","last_undegraded":"2023-09-30T01:56:00.128684+0000","last_fullsized":"2023-09-30T01:56:00.128684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:56:41.268990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150125+0000","last_change":"2023-09-30T01:56:00.148605+0000","last_active":"2023-09-30T01:56:00.150125+0000","last_peered":"2023-09-30T01:56:00.150125+0000","last_clean":"2023-09-30T01:56:00.150125+0000","last_became_active":"2023-09-30T01:56:00.148253+0000","last_became_peered":"2023-09-30T01:56:00.148253+0000","last_unstale":"2023-09-30T01:56:00.150125+0000","last_undegraded":"2023-09-30T01:56:00.150125+0000","last_fullsized":"2023-09-30T01:56:00.150125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:34:19.920224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.132428+0000","last_change":"2023-09-30T01:55:55.599574+0000","last_active":"2023-09-30T01:56:00.132428+0000","last_peered":"2023-09-30T01:56:00.132428+0000","last_clean":"2023-09-30T01:56:00.132428+0000","last_became_active":"2023-09-30T01:55:55.598970+0000","last_became_peered":"2023-09-30T01:55:55.598970+0000","last_unstale":"2023-09-30T01:56:00.132428+0000","last_undegraded":"2023-09-30T01:56:00.132428+0000","last_fullsized":"2023-09-30T01:56:00.132428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:53.195170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.121970+0000","last_change":"2023-09-30T01:55:59.769829+0000","last_active":"2023-09-30T01:56:00.121970+0000","last_peered":"2023-09-30T01:56:00.121970+0000","last_clean":"2023-09-30T01:56:00.121970+0000","last_became_active":"2023-09-30T01:55:59.769519+0000","last_became_peered":"2023-09-30T01:55:59.769519+0000","last_unstale":"2023-09-30T01:56:00.121970+0000","last_undegraded":"2023-09-30T01:56:00.121970+0000","last_fullsized":"2023-09-30T01:56:00.121970+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:27:45.755265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157448+0000","last_change":"2023-09-30T01:56:00.154436+0000","last_active":"2023-09-30T01:56:00.157448+0000","last_peered":"2023-09-30T01:56:00.157448+0000","last_clean":"2023-09-30T01:56:00.157448+0000","last_became_active":"2023-09-30T01:56:00.154030+0000","last_became_peered":"2023-09-30T01:56:00.154030+0000","last_unstale":"2023-09-30T01:56:00.157448+0000","last_undegraded":"2023-09-30T01:56:00.157448+0000","last_fullsized":"2023-09-30T01:56:00.157448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:48:07.197805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.114706+0000","last_change":"2023-09-30T01:55:56.090039+0000","last_active":"2023-09-30T01:56:00.114706+0000","last_peered":"2023-09-30T01:56:00.114706+0000","last_clean":"2023-09-30T01:56:00.114706+0000","last_became_active":"2023-09-30T01:55:56.089292+0000","last_became_peered":"2023-09-30T01:55:56.089292+0000","last_unstale":"2023-09-30T01:56:00.114706+0000","last_undegraded":"2023-09-30T01:56:00.114706+0000","last_fullsized":"2023-09-30T01:56:00.114706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:04:26.068674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.122368+0000","last_change":"2023-09-30T01:55:59.768182+0000","last_active":"2023-09-30T01:56:00.122368+0000","last_peered":"2023-09-30T01:56:00.122368+0000","last_clean":"2023-09-30T01:56:00.122368+0000","last_became_active":"2023-09-30T01:55:59.767808+0000","last_became_peered":"2023-09-30T01:55:59.767808+0000","last_unstale":"2023-09-30T01:56:00.122368+0000","last_undegraded":"2023-09-30T01:56:00.122368+0000","last_fullsized":"2023-09-30T01:56:00.122368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:50:39.919553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.152919+0000","last_change":"2023-09-30T01:56:00.146334+0000","last_active":"2023-09-30T01:56:00.152919+0000","last_peered":"2023-09-30T01:56:00.152919+0000","last_clean":"2023-09-30T01:56:00.152919+0000","last_became_active":"2023-09-30T01:56:00.146038+0000","last_became_peered":"2023-09-30T01:56:00.146038+0000","last_unstale":"2023-09-30T01:56:00.152919+0000","last_undegraded":"2023-09-30T01:56:00.152919+0000","last_fullsized":"2023-09-30T01:56:00.152919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:32:23.254275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127237+0000","last_change":"2023-09-30T01:55:55.600117+0000","last_active":"2023-09-30T01:56:00.127237+0000","last_peered":"2023-09-30T01:56:00.127237+0000","last_clean":"2023-09-30T01:56:00.127237+0000","last_became_active":"2023-09-30T01:55:55.599019+0000","last_became_peered":"2023-09-30T01:55:55.599019+0000","last_unstale":"2023-09-30T01:56:00.127237+0000","last_undegraded":"2023-09-30T01:56:00.127237+0000","last_fullsized":"2023-09-30T01:56:00.127237+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:18:37.420194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127301+0000","last_change":"2023-09-30T01:55:59.777990+0000","last_active":"2023-09-30T01:56:00.127301+0000","last_peered":"2023-09-30T01:56:00.127301+0000","last_clean":"2023-09-30T01:56:00.127301+0000","last_became_active":"2023-09-30T01:55:59.777675+0000","last_became_peered":"2023-09-30T01:55:59.777675+0000","last_unstale":"2023-09-30T01:56:00.127301+0000","last_undegraded":"2023-09-30T01:56:00.127301+0000","last_fullsized":"2023-09-30T01:56:00.127301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:26:30.591338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150426+0000","last_change":"2023-09-30T01:56:00.139198+0000","last_active":"2023-09-30T01:56:00.150426+0000","last_peered":"2023-09-30T01:56:00.150426+0000","last_clean":"2023-09-30T01:56:00.150426+0000","last_became_active":"2023-09-30T01:56:00.138489+0000","last_became_peered":"2023-09-30T01:56:00.138489+0000","last_unstale":"2023-09-30T01:56:00.150426+0000","last_undegraded":"2023-09-30T01:56:00.150426+0000","last_fullsized":"2023-09-30T01:56:00.150426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:20:12.451240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129721+0000","last_change":"2023-09-30T01:55:59.785288+0000","last_active":"2023-09-30T01:56:00.129721+0000","last_peered":"2023-09-30T01:56:00.129721+0000","last_clean":"2023-09-30T01:56:00.129721+0000","last_became_active":"2023-09-30T01:55:59.784897+0000","last_became_peered":"2023-09-30T01:55:59.784897+0000","last_unstale":"2023-09-30T01:56:00.129721+0000","last_undegraded":"2023-09-30T01:56:00.129721+0000","last_fullsized":"2023-09-30T01:56:00.129721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:30:34.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.128920+0000","last_change":"2023-09-30T01:55:56.090103+0000","last_active":"2023-09-30T01:56:00.128920+0000","last_peered":"2023-09-30T01:56:00.128920+0000","last_clean":"2023-09-30T01:56:00.128920+0000","last_became_active":"2023-09-30T01:55:56.089319+0000","last_became_peered":"2023-09-30T01:55:56.089319+0000","last_unstale":"2023-09-30T01:56:00.128920+0000","last_undegraded":"2023-09-30T01:56:00.128920+0000","last_fullsized":"2023-09-30T01:56:00.128920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:29.888440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157373+0000","last_change":"2023-09-30T01:56:00.152652+0000","last_active":"2023-09-30T01:56:00.157373+0000","last_peered":"2023-09-30T01:56:00.157373+0000","last_clean":"2023-09-30T01:56:00.157373+0000","last_became_active":"2023-09-30T01:56:00.152301+0000","last_became_peered":"2023-09-30T01:56:00.152301+0000","last_unstale":"2023-09-30T01:56:00.157373+0000","last_undegraded":"2023-09-30T01:56:00.157373+0000","last_fullsized":"2023-09-30T01:56:00.157373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:37.790754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.122972+0000","last_change":"2023-09-30T01:55:59.768001+0000","last_active":"2023-09-30T01:56:00.122972+0000","last_peered":"2023-09-30T01:56:00.122972+0000","last_clean":"2023-09-30T01:56:00.122972+0000","last_became_active":"2023-09-30T01:55:59.767723+0000","last_became_peered":"2023-09-30T01:55:59.767723+0000","last_unstale":"2023-09-30T01:56:00.122972+0000","last_undegraded":"2023-09-30T01:56:00.122972+0000","last_fullsized":"2023-09-30T01:56:00.122972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:08:09.194250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129835+0000","last_change":"2023-09-30T01:55:55.597415+0000","last_active":"2023-09-30T01:56:00.129835+0000","last_peered":"2023-09-30T01:56:00.129835+0000","last_clean":"2023-09-30T01:56:00.129835+0000","last_became_active":"2023-09-30T01:55:55.596836+0000","last_became_peered":"2023-09-30T01:55:55.596836+0000","last_unstale":"2023-09-30T01:56:00.129835+0000","last_undegraded":"2023-09-30T01:56:00.129835+0000","last_fullsized":"2023-09-30T01:56:00.129835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:29.888440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.153282+0000","last_change":"2023-09-30T01:56:00.147047+0000","last_active":"2023-09-30T01:56:00.153282+0000","last_peered":"2023-09-30T01:56:00.153282+0000","last_clean":"2023-09-30T01:56:00.153282+0000","last_became_active":"2023-09-30T01:56:00.146771+0000","last_became_peered":"2023-09-30T01:56:00.146771+0000","last_unstale":"2023-09-30T01:56:00.153282+0000","last_undegraded":"2023-09-30T01:56:00.153282+0000","last_fullsized":"2023-09-30T01:56:00.153282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:34:19.920224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.154263+0000","last_change":"2023-09-30T01:55:59.786446+0000","last_active":"2023-09-30T01:56:00.154263+0000","last_peered":"2023-09-30T01:56:00.154263+0000","last_clean":"2023-09-30T01:56:00.154263+0000","last_became_active":"2023-09-30T01:55:59.786162+0000","last_became_peered":"2023-09-30T01:55:59.786162+0000","last_unstale":"2023-09-30T01:56:00.154263+0000","last_undegraded":"2023-09-30T01:56:00.154263+0000","last_fullsized":"2023-09-30T01:56:00.154263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:19.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.123255+0000","last_change":"2023-09-30T01:55:55.597920+0000","last_active":"2023-09-30T01:56:00.123255+0000","last_peered":"2023-09-30T01:56:00.123255+0000","last_clean":"2023-09-30T01:56:00.123255+0000","last_became_active":"2023-09-30T01:55:55.597433+0000","last_became_peered":"2023-09-30T01:55:55.597433+0000","last_unstale":"2023-09-30T01:56:00.123255+0000","last_undegraded":"2023-09-30T01:56:00.123255+0000","last_fullsized":"2023-09-30T01:56:00.123255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:11:56.914296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157594+0000","last_change":"2023-09-30T01:56:00.154867+0000","last_active":"2023-09-30T01:56:00.157594+0000","last_peered":"2023-09-30T01:56:00.157594+0000","last_clean":"2023-09-30T01:56:00.157594+0000","last_became_active":"2023-09-30T01:56:00.154091+0000","last_became_peered":"2023-09-30T01:56:00.154091+0000","last_unstale":"2023-09-30T01:56:00.157594+0000","last_undegraded":"2023-09-30T01:56:00.157594+0000","last_fullsized":"2023-09-30T01:56:00.157594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:10:11.219000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T01:56:02.976593+0000","last_change":"2023-09-30T01:55:59.774863+0000","last_active":"2023-09-30T01:56:02.976593+0000","last_peered":"2023-09-30T01:56:02.976593+0000","last_clean":"2023-09-30T01:56:02.976593+0000","last_became_active":"2023-09-30T01:55:59.774177+0000","last_became_peered":"2023-09-30T01:55:59.774177+0000","last_unstale":"2023-09-30T01:56:02.976593+0000","last_undegraded":"2023-09-30T01:56:02.976593+0000","last_fullsized":"2023-09-30T01:56:02.976593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:41:38.413142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129713+0000","last_change":"2023-09-30T01:55:55.599569+0000","last_active":"2023-09-30T01:56:00.129713+0000","last_peered":"2023-09-30T01:56:00.129713+0000","last_clean":"2023-09-30T01:56:00.129713+0000","last_became_active":"2023-09-30T01:55:55.599037+0000","last_became_peered":"2023-09-30T01:55:55.599037+0000","last_unstale":"2023-09-30T01:56:00.129713+0000","last_undegraded":"2023-09-30T01:56:00.129713+0000","last_fullsized":"2023-09-30T01:56:00.129713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:03:37.621500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.134188+0000","last_change":"2023-09-30T01:56:00.126614+0000","last_active":"2023-09-30T01:56:00.134188+0000","last_peered":"2023-09-30T01:56:00.134188+0000","last_clean":"2023-09-30T01:56:00.134188+0000","last_became_active":"2023-09-30T01:56:00.126138+0000","last_became_peered":"2023-09-30T01:56:00.126138+0000","last_unstale":"2023-09-30T01:56:00.134188+0000","last_undegraded":"2023-09-30T01:56:00.134188+0000","last_fullsized":"2023-09-30T01:56:00.134188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:55.327377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.135607+0000","last_change":"2023-09-30T01:56:00.126588+0000","last_active":"2023-09-30T01:56:00.135607+0000","last_peered":"2023-09-30T01:56:00.135607+0000","last_clean":"2023-09-30T01:56:00.135607+0000","last_became_active":"2023-09-30T01:56:00.126004+0000","last_became_peered":"2023-09-30T01:56:00.126004+0000","last_unstale":"2023-09-30T01:56:00.135607+0000","last_undegraded":"2023-09-30T01:56:00.135607+0000","last_fullsized":"2023-09-30T01:56:00.135607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:41:39.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.149154+0000","last_change":"2023-09-30T01:55:59.772026+0000","last_active":"2023-09-30T01:56:00.149154+0000","last_peered":"2023-09-30T01:56:00.149154+0000","last_clean":"2023-09-30T01:56:00.149154+0000","last_became_active":"2023-09-30T01:55:59.771159+0000","last_became_peered":"2023-09-30T01:55:59.771159+0000","last_unstale":"2023-09-30T01:56:00.149154+0000","last_undegraded":"2023-09-30T01:56:00.149154+0000","last_fullsized":"2023-09-30T01:56:00.149154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:06:00.627501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155934+0000","last_change":"2023-09-30T01:56:00.152010+0000","last_active":"2023-09-30T01:56:00.155934+0000","last_peered":"2023-09-30T01:56:00.155934+0000","last_clean":"2023-09-30T01:56:00.155934+0000","last_became_active":"2023-09-30T01:56:00.150656+0000","last_became_peered":"2023-09-30T01:56:00.150656+0000","last_unstale":"2023-09-30T01:56:00.155934+0000","last_undegraded":"2023-09-30T01:56:00.155934+0000","last_fullsized":"2023-09-30T01:56:00.155934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:32:22.927822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.141536+0000","last_change":"2023-09-30T01:55:59.780797+0000","last_active":"2023-09-30T01:56:00.141536+0000","last_peered":"2023-09-30T01:56:00.141536+0000","last_clean":"2023-09-30T01:56:00.141536+0000","last_became_active":"2023-09-30T01:55:59.780499+0000","last_became_peered":"2023-09-30T01:55:59.780499+0000","last_unstale":"2023-09-30T01:56:00.141536+0000","last_undegraded":"2023-09-30T01:56:00.141536+0000","last_fullsized":"2023-09-30T01:56:00.141536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:03:41.802753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.128419+0000","last_change":"2023-09-30T01:55:59.781249+0000","last_active":"2023-09-30T01:56:00.128419+0000","last_peered":"2023-09-30T01:56:00.128419+0000","last_clean":"2023-09-30T01:56:00.128419+0000","last_became_active":"2023-09-30T01:55:59.780891+0000","last_became_peered":"2023-09-30T01:55:59.780891+0000","last_unstale":"2023-09-30T01:56:00.128419+0000","last_undegraded":"2023-09-30T01:56:00.128419+0000","last_fullsized":"2023-09-30T01:56:00.128419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:40:23.099697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148788+0000","last_change":"2023-09-30T01:56:00.143575+0000","last_active":"2023-09-30T01:56:00.148788+0000","last_peered":"2023-09-30T01:56:00.148788+0000","last_clean":"2023-09-30T01:56:00.148788+0000","last_became_active":"2023-09-30T01:56:00.143091+0000","last_became_peered":"2023-09-30T01:56:00.143091+0000","last_unstale":"2023-09-30T01:56:00.148788+0000","last_undegraded":"2023-09-30T01:56:00.148788+0000","last_fullsized":"2023-09-30T01:56:00.148788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:42.194028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.131397+0000","last_change":"2023-09-30T01:55:59.774448+0000","last_active":"2023-09-30T01:56:00.131397+0000","last_peered":"2023-09-30T01:56:00.131397+0000","last_clean":"2023-09-30T01:56:00.131397+0000","last_became_active":"2023-09-30T01:55:59.774120+0000","last_became_peered":"2023-09-30T01:55:59.774120+0000","last_unstale":"2023-09-30T01:56:00.131397+0000","last_undegraded":"2023-09-30T01:56:00.131397+0000","last_fullsized":"2023-09-30T01:56:00.131397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:26:30.591338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157610+0000","last_change":"2023-09-30T01:56:00.154894+0000","last_active":"2023-09-30T01:56:00.157610+0000","last_peered":"2023-09-30T01:56:00.157610+0000","last_clean":"2023-09-30T01:56:00.157610+0000","last_became_active":"2023-09-30T01:56:00.154551+0000","last_became_peered":"2023-09-30T01:56:00.154551+0000","last_unstale":"2023-09-30T01:56:00.157610+0000","last_undegraded":"2023-09-30T01:56:00.157610+0000","last_fullsized":"2023-09-30T01:56:00.157610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:31.820081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145272+0000","last_change":"2023-09-30T01:56:00.143924+0000","last_active":"2023-09-30T01:56:00.145272+0000","last_peered":"2023-09-30T01:56:00.145272+0000","last_clean":"2023-09-30T01:56:00.145272+0000","last_became_active":"2023-09-30T01:56:00.143739+0000","last_became_peered":"2023-09-30T01:56:00.143739+0000","last_unstale":"2023-09-30T01:56:00.145272+0000","last_undegraded":"2023-09-30T01:56:00.145272+0000","last_fullsized":"2023-09-30T01:56:00.145272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:16:47.636345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129425+0000","last_change":"2023-09-30T01:55:59.784068+0000","last_active":"2023-09-30T01:56:00.129425+0000","last_peered":"2023-09-30T01:56:00.129425+0000","last_clean":"2023-09-30T01:56:00.129425+0000","last_became_active":"2023-09-30T01:55:59.783547+0000","last_became_peered":"2023-09-30T01:55:59.783547+0000","last_unstale":"2023-09-30T01:56:00.129425+0000","last_undegraded":"2023-09-30T01:56:00.129425+0000","last_fullsized":"2023-09-30T01:56:00.129425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:50:39.919553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155902+0000","last_change":"2023-09-30T01:56:00.151969+0000","last_active":"2023-09-30T01:56:00.155902+0000","last_peered":"2023-09-30T01:56:00.155902+0000","last_clean":"2023-09-30T01:56:00.155902+0000","last_became_active":"2023-09-30T01:56:00.150744+0000","last_became_peered":"2023-09-30T01:56:00.150744+0000","last_unstale":"2023-09-30T01:56:00.155902+0000","last_undegraded":"2023-09-30T01:56:00.155902+0000","last_fullsized":"2023-09-30T01:56:00.155902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:02:54.801532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.121874+0000","last_change":"2023-09-30T01:55:59.783093+0000","last_active":"2023-09-30T01:56:00.121874+0000","last_peered":"2023-09-30T01:56:00.121874+0000","last_clean":"2023-09-30T01:56:00.121874+0000","last_became_active":"2023-09-30T01:55:59.782532+0000","last_became_peered":"2023-09-30T01:55:59.782532+0000","last_unstale":"2023-09-30T01:56:00.121874+0000","last_undegraded":"2023-09-30T01:56:00.121874+0000","last_fullsized":"2023-09-30T01:56:00.121874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:22.053979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157524+0000","last_change":"2023-09-30T01:56:00.154425+0000","last_active":"2023-09-30T01:56:00.157524+0000","last_peered":"2023-09-30T01:56:00.157524+0000","last_clean":"2023-09-30T01:56:00.157524+0000","last_became_active":"2023-09-30T01:56:00.153913+0000","last_became_peered":"2023-09-30T01:56:00.153913+0000","last_unstale":"2023-09-30T01:56:00.157524+0000","last_undegraded":"2023-09-30T01:56:00.157524+0000","last_fullsized":"2023-09-30T01:56:00.157524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:32:22.927822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.147919+0000","last_change":"2023-09-30T01:55:59.781339+0000","last_active":"2023-09-30T01:56:00.147919+0000","last_peered":"2023-09-30T01:56:00.147919+0000","last_clean":"2023-09-30T01:56:00.147919+0000","last_became_active":"2023-09-30T01:55:59.780916+0000","last_became_peered":"2023-09-30T01:55:59.780916+0000","last_unstale":"2023-09-30T01:56:00.147919+0000","last_undegraded":"2023-09-30T01:56:00.147919+0000","last_fullsized":"2023-09-30T01:56:00.147919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:16:33.196455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145239+0000","last_change":"2023-09-30T01:56:00.135640+0000","last_active":"2023-09-30T01:56:00.145239+0000","last_peered":"2023-09-30T01:56:00.145239+0000","last_clean":"2023-09-30T01:56:00.145239+0000","last_became_active":"2023-09-30T01:56:00.135362+0000","last_became_peered":"2023-09-30T01:56:00.135362+0000","last_unstale":"2023-09-30T01:56:00.145239+0000","last_undegraded":"2023-09-30T01:56:00.145239+0000","last_fullsized":"2023-09-30T01:56:00.145239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:08:10.207253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.144433+0000","last_change":"2023-09-30T01:55:59.783858+0000","last_active":"2023-09-30T01:56:00.144433+0000","last_peered":"2023-09-30T01:56:00.144433+0000","last_clean":"2023-09-30T01:56:00.144433+0000","last_became_active":"2023-09-30T01:55:59.782368+0000","last_became_peered":"2023-09-30T01:55:59.782368+0000","last_unstale":"2023-09-30T01:56:00.144433+0000","last_undegraded":"2023-09-30T01:56:00.144433+0000","last_fullsized":"2023-09-30T01:56:00.144433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:08:09.194250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.146297+0000","last_change":"2023-09-30T01:56:00.141317+0000","last_active":"2023-09-30T01:56:00.146297+0000","last_peered":"2023-09-30T01:56:00.146297+0000","last_clean":"2023-09-30T01:56:00.146297+0000","last_became_active":"2023-09-30T01:56:00.141087+0000","last_became_peered":"2023-09-30T01:56:00.141087+0000","last_unstale":"2023-09-30T01:56:00.146297+0000","last_undegraded":"2023-09-30T01:56:00.146297+0000","last_fullsized":"2023-09-30T01:56:00.146297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:24:26.401425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.147345+0000","last_change":"2023-09-30T01:55:59.782826+0000","last_active":"2023-09-30T01:56:00.147345+0000","last_peered":"2023-09-30T01:56:00.147345+0000","last_clean":"2023-09-30T01:56:00.147345+0000","last_became_active":"2023-09-30T01:55:59.782495+0000","last_became_peered":"2023-09-30T01:55:59.782495+0000","last_unstale":"2023-09-30T01:56:00.147345+0000","last_undegraded":"2023-09-30T01:56:00.147345+0000","last_fullsized":"2023-09-30T01:56:00.147345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:56:41.268990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143147+0000","last_change":"2023-09-30T01:56:00.138415+0000","last_active":"2023-09-30T01:56:00.143147+0000","last_peered":"2023-09-30T01:56:00.143147+0000","last_clean":"2023-09-30T01:56:00.143147+0000","last_became_active":"2023-09-30T01:56:00.137941+0000","last_became_peered":"2023-09-30T01:56:00.137941+0000","last_unstale":"2023-09-30T01:56:00.143147+0000","last_undegraded":"2023-09-30T01:56:00.143147+0000","last_fullsized":"2023-09-30T01:56:00.143147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:08:55.103499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142155+0000","last_change":"2023-09-30T01:55:59.776546+0000","last_active":"2023-09-30T01:56:00.142155+0000","last_peered":"2023-09-30T01:56:00.142155+0000","last_clean":"2023-09-30T01:56:00.142155+0000","last_became_active":"2023-09-30T01:55:59.776242+0000","last_became_peered":"2023-09-30T01:55:59.776242+0000","last_unstale":"2023-09-30T01:56:00.142155+0000","last_undegraded":"2023-09-30T01:56:00.142155+0000","last_fullsized":"2023-09-30T01:56:00.142155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:24:25.388422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148797+0000","last_change":"2023-09-30T01:56:00.143686+0000","last_active":"2023-09-30T01:56:00.148797+0000","last_peered":"2023-09-30T01:56:00.148797+0000","last_clean":"2023-09-30T01:56:00.148797+0000","last_became_active":"2023-09-30T01:56:00.143388+0000","last_became_peered":"2023-09-30T01:56:00.143388+0000","last_unstale":"2023-09-30T01:56:00.148797+0000","last_undegraded":"2023-09-30T01:56:00.148797+0000","last_fullsized":"2023-09-30T01:56:00.148797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:55:57.453826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145902+0000","last_change":"2023-09-30T01:55:59.786229+0000","last_active":"2023-09-30T01:56:00.145902+0000","last_peered":"2023-09-30T01:56:00.145902+0000","last_clean":"2023-09-30T01:56:00.145902+0000","last_became_active":"2023-09-30T01:55:59.785944+0000","last_became_peered":"2023-09-30T01:55:59.785944+0000","last_unstale":"2023-09-30T01:56:00.145902+0000","last_undegraded":"2023-09-30T01:56:00.145902+0000","last_fullsized":"2023-09-30T01:56:00.145902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:23:52.565054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150643+0000","last_change":"2023-09-30T01:56:00.148962+0000","last_active":"2023-09-30T01:56:00.150643+0000","last_peered":"2023-09-30T01:56:00.150643+0000","last_clean":"2023-09-30T01:56:00.150643+0000","last_became_active":"2023-09-30T01:56:00.147919+0000","last_became_peered":"2023-09-30T01:56:00.147919+0000","last_unstale":"2023-09-30T01:56:00.150643+0000","last_undegraded":"2023-09-30T01:56:00.150643+0000","last_fullsized":"2023-09-30T01:56:00.150643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:29:29.479636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145517+0000","last_change":"2023-09-30T01:55:59.769801+0000","last_active":"2023-09-30T01:56:00.145517+0000","last_peered":"2023-09-30T01:56:00.145517+0000","last_clean":"2023-09-30T01:56:00.145517+0000","last_became_active":"2023-09-30T01:55:59.769503+0000","last_became_peered":"2023-09-30T01:55:59.769503+0000","last_unstale":"2023-09-30T01:56:00.145517+0000","last_undegraded":"2023-09-30T01:56:00.145517+0000","last_fullsized":"2023-09-30T01:56:00.145517+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:45:38.723185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8128,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363712,"statfs":{"total":96636764160,"available":96628441088,"internally_reserved":0,"allocated":188416,"data_stored":60567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":786432,"data_stored":652110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9152,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362688,"statfs":{"total":96636764160,"available":96627392512,"internally_reserved":0,"allocated":778240,"data_stored":651317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12232,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359608,"statfs":{"total":96636764160,"available":96624238592,"internally_reserved":0,"allocated":196608,"data_stored":61224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T01:56:11.119 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-09-30T01:56:11.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.223+0000 7fa85c8b9700 1 Processor -- start 2023-09-30T01:56:11.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.223+0000 7fa85c8b9700 1 -- start start 2023-09-30T01:56:11.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.223+0000 7fa85c8b9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8580a4990 0x7fa8580aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:11.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.223+0000 7fa85c8b9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8580af120 con 0x7fa85813a750 2023-09-30T01:56:11.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.223+0000 7fa85c8b9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8580af5b0 con 0x7fa8580a4d60 2023-09-30T01:56:11.229 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.223+0000 7fa85c8b9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa85809fb10 con 0x7fa8580a4990 2023-09-30T01:56:11.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.223+0000 7fa857fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fa85813a750 0x7fa85814ea60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53218/0 (socket says 172.21.15.55:53218) 2023-09-30T01:56:11.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa857fff700 1 -- 172.21.15.55:0/406166533 learned_addr learned my addr 172.21.15.55:0/406166533 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:11.230 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa8577fe700 1 --2- 172.21.15.55:0/406166533 >> v2:172.21.15.133:3300/0 conn(0x7fa8580a4990 0x7fa8580aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:11.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa8567fc700 1 -- 172.21.15.55:0/406166533 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136621595 0 0) 0x7fa8580af120 con 0x7fa85813a750 2023-09-30T01:56:11.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa8567fc700 1 -- 172.21.15.55:0/406166533 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa840003570 con 0x7fa85813a750 2023-09-30T01:56:11.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa8567fc700 1 -- 172.21.15.55:0/406166533 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1662362216 0 0) 0x7fa8580af5b0 con 0x7fa8580a4d60 2023-09-30T01:56:11.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa8567fc700 1 -- 172.21.15.55:0/406166533 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8580af120 con 0x7fa8580a4d60 2023-09-30T01:56:11.231 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa8577fe700 1 -- 172.21.15.55:0/406166533 >> v1:172.21.15.133:6789/0 conn(0x7fa8580a4d60 legacy=0x7fa8580a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa8577fe700 1 -- 172.21.15.55:0/406166533 >> v1:172.21.15.55:6789/0 conn(0x7fa85813a750 legacy=0x7fa85814ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa8577fe700 1 -- 172.21.15.55:0/406166533 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85809fdd0 con 0x7fa8580a4990 2023-09-30T01:56:11.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa8577fe700 1 --2- 172.21.15.55:0/406166533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8580a4990 0x7fa8580aeb90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0098e0 tx=0x7fa84c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e29611f34a9443cc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:11.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa8567fc700 1 -- 172.21.15.55:0/406166533 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c011630 con 0x7fa8580a4990 2023-09-30T01:56:11.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa8567fc700 1 -- 172.21.15.55:0/406166533 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84c011790 con 0x7fa8580a4990 2023-09-30T01:56:11.232 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa8567fc700 1 -- 172.21.15.55:0/406166533 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c011b30 con 0x7fa8580a4990 2023-09-30T01:56:11.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa85c8b9700 1 -- 172.21.15.55:0/406166533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8580a4990 msgr2=0x7fa8580aeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa85c8b9700 1 --2- 172.21.15.55:0/406166533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8580a4990 0x7fa8580aeb90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa84c0098e0 tx=0x7fa84c0091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa85c8b9700 1 -- 172.21.15.55:0/406166533 shutdown_connections 2023-09-30T01:56:11.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa85c8b9700 1 --2- 172.21.15.55:0/406166533 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8580a4990 0x7fa8580aeb90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa85c8b9700 1 -- 172.21.15.55:0/406166533 >> 172.21.15.55:0/406166533 conn(0x7fa8580b23d0 msgr2=0x7fa8580b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:11.233 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa85c8b9700 1 -- 172.21.15.55:0/406166533 shutdown_connections 2023-09-30T01:56:11.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa85c8b9700 1 -- 172.21.15.55:0/406166533 wait complete. 2023-09-30T01:56:11.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.227+0000 7fa85c8b9700 1 Processor -- start 2023-09-30T01:56:11.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa85c8b9700 1 -- start start 2023-09-30T01:56:11.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa85c8b9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8580a4990 0x7fa858099010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:11.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa85c8b9700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8580a4d60 0x7fa858148bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:11.236 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa85c8b9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa85813a750 0x7fa858149100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:11.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa85c8b9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa858149640 con 0x7fa8580a4990 2023-09-30T01:56:11.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa85c8b9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8580988e0 con 0x7fa85813a750 2023-09-30T01:56:11.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa85c8b9700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa858149870 con 0x7fa8580a4d60 2023-09-30T01:56:11.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa8577fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8580a4990 0x7fa858099010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:11.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa8577fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8580a4990 0x7fa858099010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:40118/0 (socket says 172.21.15.55:40118) 2023-09-30T01:56:11.237 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa8577fe700 1 -- 172.21.15.55:0/449759115 learned_addr learned my addr 172.21.15.55:0/449759115 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:11.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa856ffd700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8580a4d60 0x7fa858148bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:11.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa857fff700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa85813a750 0x7fa858149100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:11.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa8577fe700 1 -- 172.21.15.55:0/449759115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8580a4d60 msgr2=0x7fa858148bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa8577fe700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8580a4d60 0x7fa858148bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa8577fe700 1 -- 172.21.15.55:0/449759115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa85813a750 msgr2=0x7fa858149100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa8577fe700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa85813a750 0x7fa858149100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa8577fe700 1 -- 172.21.15.55:0/449759115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa84c009420 con 0x7fa8580a4990 2023-09-30T01:56:11.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa857fff700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa85813a750 0x7fa858149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T01:56:11.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa8577fe700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8580a4990 0x7fa858099010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa858064210 tx=0x7fa84c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:11.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa83f7fe700 1 -- 172.21.15.55:0/449759115 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c01f070 con 0x7fa8580a4990 2023-09-30T01:56:11.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa83f7fe700 1 -- 172.21.15.55:0/449759115 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa84c000bc0 con 0x7fa8580a4990 2023-09-30T01:56:11.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa83f7fe700 1 -- 172.21.15.55:0/449759115 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa84c025420 con 0x7fa8580a4990 2023-09-30T01:56:11.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa85c8b9700 1 -- 172.21.15.55:0/449759115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa858149b30 con 0x7fa8580a4990 2023-09-30T01:56:11.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.231+0000 7fa85c8b9700 1 -- 172.21.15.55:0/449759115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa85814a330 con 0x7fa8580a4990 2023-09-30T01:56:11.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.235+0000 7fa85c8b9700 1 -- 172.21.15.55:0/449759115 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa858064440 con 0x7fa8580a4990 2023-09-30T01:56:11.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.235+0000 7fa83f7fe700 1 -- 172.21.15.55:0/449759115 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fa84c023070 con 0x7fa8580a4990 2023-09-30T01:56:11.240 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.235+0000 7fa83f7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.235+0000 7fa83f7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.235+0000 7fa83f7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.235+0000 7fa83f7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.235+0000 7fa83f7fe700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa84408e8b0 0x7fa844090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.235+0000 7fa83f7fe700 1 -- 172.21.15.55:0/449759115 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fa84c0b5da0 con 0x7fa8580a4990 2023-09-30T01:56:11.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.235+0000 7fa856ffd700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa84408e8b0 0x7fa844090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:11.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.239+0000 7fa856ffd700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa84408e8b0 0x7fa844090d60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa848007fd0 tx=0x7fa848007d50 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:11.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.239+0000 7fa83f7fe700 1 -- 172.21.15.55:0/449759115 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa84c086860 con 0x7fa8580a4990 2023-09-30T01:56:11.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.395+0000 7fa85c8b9700 20 mgrc start_command cmd: [{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}] 2023-09-30T01:56:11.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.395+0000 7fa85c8b9700 1 -- 172.21.15.55:0/449759115 --> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa85814a550 con 0x7fa84408e8b0 2023-09-30T01:56:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.403+0000 7fa83f7fe700 1 -- 172.21.15.55:0/449759115 <== mgr.4103 v2:172.21.15.55:6808/27538 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+269322 (secure 0 0 0) 0x7fa85814a550 con 0x7fa84408e8b0 2023-09-30T01:56:11.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.403+0000 7fa83f7fe700 20 mgrc handle_command_reply tid 0 r 0 2023-09-30T01:56:11.412 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:11.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.407+0000 7fa85c8b9700 10 mgrc shutdown 2023-09-30T01:56:11.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.407+0000 7fa85c8b9700 1 -- 172.21.15.55:0/449759115 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa84408e8b0 msgr2=0x7fa844090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.407+0000 7fa85c8b9700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa84408e8b0 0x7fa844090d60 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa848007fd0 tx=0x7fa848007d50 comp rx=0 tx=0).stop 2023-09-30T01:56:11.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.407+0000 7fa85c8b9700 1 -- 172.21.15.55:0/449759115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8580a4990 msgr2=0x7fa858099010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.407+0000 7fa85c8b9700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8580a4990 0x7fa858099010 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fa858064210 tx=0x7fa84c017000 comp rx=0 tx=0).stop 2023-09-30T01:56:11.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.411+0000 7fa85c8b9700 1 -- 172.21.15.55:0/449759115 shutdown_connections 2023-09-30T01:56:11.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.411+0000 7fa85c8b9700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa85813a750 0x7fa858149100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.411+0000 7fa85c8b9700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa84408e8b0 0x7fa844090d60 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.411+0000 7fa85c8b9700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8580a4d60 0x7fa858148bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.411+0000 7fa85c8b9700 1 --2- 172.21.15.55:0/449759115 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8580a4990 0x7fa858099010 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.411+0000 7fa85c8b9700 1 -- 172.21.15.55:0/449759115 >> 172.21.15.55:0/449759115 conn(0x7fa8580b23d0 msgr2=0x7fa8580a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:11.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.411+0000 7fa85c8b9700 1 -- 172.21.15.55:0/449759115 shutdown_connections 2023-09-30T01:56:11.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.411+0000 7fa85c8b9700 1 -- 172.21.15.55:0/449759115 wait complete. 2023-09-30T01:56:11.415 INFO:teuthology.orchestra.run.smithi055.stderr:dumped all 2023-09-30T01:56:11.427 INFO:teuthology.orchestra.run.smithi055.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2023-09-30T01:56:11.032994+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":38608,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":36672,"kb_avail":377448752,"statfs":{"total":386547056640,"available":386507522048,"internally_reserved":0,"allocated":1949696,"data_stored":1425218,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37552128},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.004006"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145491+0000","last_change":"2023-09-30T01:56:00.139640+0000","last_active":"2023-09-30T01:56:00.145491+0000","last_peered":"2023-09-30T01:56:00.145491+0000","last_clean":"2023-09-30T01:56:00.145491+0000","last_became_active":"2023-09-30T01:56:00.139371+0000","last_became_peered":"2023-09-30T01:56:00.139371+0000","last_unstale":"2023-09-30T01:56:00.145491+0000","last_undegraded":"2023-09-30T01:56:00.145491+0000","last_fullsized":"2023-09-30T01:56:00.145491+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:24:15.189346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150056+0000","last_change":"2023-09-30T01:56:00.148833+0000","last_active":"2023-09-30T01:56:00.150056+0000","last_peered":"2023-09-30T01:56:00.150056+0000","last_clean":"2023-09-30T01:56:00.150056+0000","last_became_active":"2023-09-30T01:56:00.148030+0000","last_became_peered":"2023-09-30T01:56:00.148030+0000","last_unstale":"2023-09-30T01:56:00.150056+0000","last_undegraded":"2023-09-30T01:56:00.150056+0000","last_fullsized":"2023-09-30T01:56:00.150056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:32:23.254275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150085+0000","last_change":"2023-09-30T01:56:00.148504+0000","last_active":"2023-09-30T01:56:00.150085+0000","last_peered":"2023-09-30T01:56:00.150085+0000","last_clean":"2023-09-30T01:56:00.150085+0000","last_became_active":"2023-09-30T01:56:00.148039+0000","last_became_peered":"2023-09-30T01:56:00.148039+0000","last_unstale":"2023-09-30T01:56:00.150085+0000","last_undegraded":"2023-09-30T01:56:00.150085+0000","last_fullsized":"2023-09-30T01:56:00.150085+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:30:20.150172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155598+0000","last_change":"2023-09-30T01:56:00.148000+0000","last_active":"2023-09-30T01:56:00.155598+0000","last_peered":"2023-09-30T01:56:00.155598+0000","last_clean":"2023-09-30T01:56:00.155598+0000","last_became_active":"2023-09-30T01:56:00.147578+0000","last_became_peered":"2023-09-30T01:56:00.147578+0000","last_unstale":"2023-09-30T01:56:00.155598+0000","last_undegraded":"2023-09-30T01:56:00.155598+0000","last_fullsized":"2023-09-30T01:56:00.155598+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:04.461529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.149753+0000","last_change":"2023-09-30T01:56:00.145999+0000","last_active":"2023-09-30T01:56:00.149753+0000","last_peered":"2023-09-30T01:56:00.149753+0000","last_clean":"2023-09-30T01:56:00.149753+0000","last_became_active":"2023-09-30T01:56:00.145352+0000","last_became_peered":"2023-09-30T01:56:00.145352+0000","last_unstale":"2023-09-30T01:56:00.149753+0000","last_undegraded":"2023-09-30T01:56:00.149753+0000","last_fullsized":"2023-09-30T01:56:00.149753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:31:18.857698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148578+0000","last_change":"2023-09-30T01:56:00.143060+0000","last_active":"2023-09-30T01:56:00.148578+0000","last_peered":"2023-09-30T01:56:00.148578+0000","last_clean":"2023-09-30T01:56:00.148578+0000","last_became_active":"2023-09-30T01:56:00.142616+0000","last_became_peered":"2023-09-30T01:56:00.142616+0000","last_unstale":"2023-09-30T01:56:00.148578+0000","last_undegraded":"2023-09-30T01:56:00.148578+0000","last_fullsized":"2023-09-30T01:56:00.148578+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:41:29.282659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148779+0000","last_change":"2023-09-30T01:56:00.143260+0000","last_active":"2023-09-30T01:56:00.148779+0000","last_peered":"2023-09-30T01:56:00.148779+0000","last_clean":"2023-09-30T01:56:00.148779+0000","last_became_active":"2023-09-30T01:56:00.142575+0000","last_became_peered":"2023-09-30T01:56:00.142575+0000","last_unstale":"2023-09-30T01:56:00.148779+0000","last_undegraded":"2023-09-30T01:56:00.148779+0000","last_fullsized":"2023-09-30T01:56:00.148779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:37.790754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143024+0000","last_change":"2023-09-30T01:56:00.137083+0000","last_active":"2023-09-30T01:56:00.143024+0000","last_peered":"2023-09-30T01:56:00.143024+0000","last_clean":"2023-09-30T01:56:00.143024+0000","last_became_active":"2023-09-30T01:56:00.136730+0000","last_became_peered":"2023-09-30T01:56:00.136730+0000","last_unstale":"2023-09-30T01:56:00.143024+0000","last_undegraded":"2023-09-30T01:56:00.143024+0000","last_fullsized":"2023-09-30T01:56:00.143024+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:06:04.461529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145712+0000","last_change":"2023-09-30T01:56:00.141053+0000","last_active":"2023-09-30T01:56:00.145712+0000","last_peered":"2023-09-30T01:56:00.145712+0000","last_clean":"2023-09-30T01:56:00.145712+0000","last_became_active":"2023-09-30T01:56:00.140018+0000","last_became_peered":"2023-09-30T01:56:00.140018+0000","last_unstale":"2023-09-30T01:56:00.145712+0000","last_undegraded":"2023-09-30T01:56:00.145712+0000","last_fullsized":"2023-09-30T01:56:00.145712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:14:33.172803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.152909+0000","last_change":"2023-09-30T01:56:00.146386+0000","last_active":"2023-09-30T01:56:00.152909+0000","last_peered":"2023-09-30T01:56:00.152909+0000","last_clean":"2023-09-30T01:56:00.152909+0000","last_became_active":"2023-09-30T01:56:00.146117+0000","last_became_peered":"2023-09-30T01:56:00.146117+0000","last_unstale":"2023-09-30T01:56:00.152909+0000","last_undegraded":"2023-09-30T01:56:00.152909+0000","last_fullsized":"2023-09-30T01:56:00.152909+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:55:44.330139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155662+0000","last_change":"2023-09-30T01:56:00.150324+0000","last_active":"2023-09-30T01:56:00.155662+0000","last_peered":"2023-09-30T01:56:00.155662+0000","last_clean":"2023-09-30T01:56:00.155662+0000","last_became_active":"2023-09-30T01:56:00.150121+0000","last_became_peered":"2023-09-30T01:56:00.150121+0000","last_unstale":"2023-09-30T01:56:00.155662+0000","last_undegraded":"2023-09-30T01:56:00.155662+0000","last_fullsized":"2023-09-30T01:56:00.155662+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:37:10.888007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145198+0000","last_change":"2023-09-30T01:56:00.135304+0000","last_active":"2023-09-30T01:56:00.145198+0000","last_peered":"2023-09-30T01:56:00.145198+0000","last_clean":"2023-09-30T01:56:00.145198+0000","last_became_active":"2023-09-30T01:56:00.134990+0000","last_became_peered":"2023-09-30T01:56:00.134990+0000","last_unstale":"2023-09-30T01:56:00.145198+0000","last_undegraded":"2023-09-30T01:56:00.145198+0000","last_fullsized":"2023-09-30T01:56:00.145198+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:26:31.604340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145469+0000","last_change":"2023-09-30T01:56:00.139589+0000","last_active":"2023-09-30T01:56:00.145469+0000","last_peered":"2023-09-30T01:56:00.145469+0000","last_clean":"2023-09-30T01:56:00.145469+0000","last_became_active":"2023-09-30T01:56:00.139313+0000","last_became_peered":"2023-09-30T01:56:00.139313+0000","last_unstale":"2023-09-30T01:56:00.145469+0000","last_undegraded":"2023-09-30T01:56:00.145469+0000","last_fullsized":"2023-09-30T01:56:00.145469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:20.598891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143004+0000","last_change":"2023-09-30T01:56:00.136514+0000","last_active":"2023-09-30T01:56:00.143004+0000","last_peered":"2023-09-30T01:56:00.143004+0000","last_clean":"2023-09-30T01:56:00.143004+0000","last_became_active":"2023-09-30T01:56:00.136143+0000","last_became_peered":"2023-09-30T01:56:00.136143+0000","last_unstale":"2023-09-30T01:56:00.143004+0000","last_undegraded":"2023-09-30T01:56:00.143004+0000","last_fullsized":"2023-09-30T01:56:00.143004+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:27:08.978174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142786+0000","last_change":"2023-09-30T01:56:00.135556+0000","last_active":"2023-09-30T01:56:00.142786+0000","last_peered":"2023-09-30T01:56:00.142786+0000","last_clean":"2023-09-30T01:56:00.142786+0000","last_became_active":"2023-09-30T01:56:00.135247+0000","last_became_peered":"2023-09-30T01:56:00.135247+0000","last_unstale":"2023-09-30T01:56:00.142786+0000","last_undegraded":"2023-09-30T01:56:00.142786+0000","last_fullsized":"2023-09-30T01:56:00.142786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:55:44.330139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143006+0000","last_change":"2023-09-30T01:56:00.136819+0000","last_active":"2023-09-30T01:56:00.143006+0000","last_peered":"2023-09-30T01:56:00.143006+0000","last_clean":"2023-09-30T01:56:00.143006+0000","last_became_active":"2023-09-30T01:56:00.136318+0000","last_became_peered":"2023-09-30T01:56:00.136318+0000","last_unstale":"2023-09-30T01:56:00.143006+0000","last_undegraded":"2023-09-30T01:56:00.143006+0000","last_fullsized":"2023-09-30T01:56:00.143006+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:37:10.888007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.138731+0000","last_change":"2023-09-30T01:56:00.132691+0000","last_active":"2023-09-30T01:56:00.138731+0000","last_peered":"2023-09-30T01:56:00.138731+0000","last_clean":"2023-09-30T01:56:00.138731+0000","last_became_active":"2023-09-30T01:56:00.132457+0000","last_became_peered":"2023-09-30T01:56:00.132457+0000","last_unstale":"2023-09-30T01:56:00.138731+0000","last_undegraded":"2023-09-30T01:56:00.138731+0000","last_fullsized":"2023-09-30T01:56:00.138731+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:31:18.857698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148808+0000","last_change":"2023-09-30T01:56:00.145655+0000","last_active":"2023-09-30T01:56:00.148808+0000","last_peered":"2023-09-30T01:56:00.148808+0000","last_clean":"2023-09-30T01:56:00.148808+0000","last_became_active":"2023-09-30T01:56:00.145375+0000","last_became_peered":"2023-09-30T01:56:00.145375+0000","last_unstale":"2023-09-30T01:56:00.148808+0000","last_undegraded":"2023-09-30T01:56:00.148808+0000","last_fullsized":"2023-09-30T01:56:00.148808+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:25:31.249335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145423+0000","last_change":"2023-09-30T01:56:00.138951+0000","last_active":"2023-09-30T01:56:00.145423+0000","last_peered":"2023-09-30T01:56:00.145423+0000","last_clean":"2023-09-30T01:56:00.145423+0000","last_became_active":"2023-09-30T01:56:00.138624+0000","last_became_peered":"2023-09-30T01:56:00.138624+0000","last_unstale":"2023-09-30T01:56:00.145423+0000","last_undegraded":"2023-09-30T01:56:00.145423+0000","last_fullsized":"2023-09-30T01:56:00.145423+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:06:01.640504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155882+0000","last_change":"2023-09-30T01:56:00.150510+0000","last_active":"2023-09-30T01:56:00.155882+0000","last_peered":"2023-09-30T01:56:00.155882+0000","last_clean":"2023-09-30T01:56:00.155882+0000","last_became_active":"2023-09-30T01:56:00.150173+0000","last_became_peered":"2023-09-30T01:56:00.150173+0000","last_unstale":"2023-09-30T01:56:00.155882+0000","last_undegraded":"2023-09-30T01:56:00.155882+0000","last_fullsized":"2023-09-30T01:56:00.155882+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:41:29.282659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143136+0000","last_change":"2023-09-30T01:56:00.138339+0000","last_active":"2023-09-30T01:56:00.143136+0000","last_peered":"2023-09-30T01:56:00.143136+0000","last_clean":"2023-09-30T01:56:00.143136+0000","last_became_active":"2023-09-30T01:56:00.138000+0000","last_became_peered":"2023-09-30T01:56:00.138000+0000","last_unstale":"2023-09-30T01:56:00.143136+0000","last_undegraded":"2023-09-30T01:56:00.143136+0000","last_fullsized":"2023-09-30T01:56:00.143136+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:50:54.628959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157391+0000","last_change":"2023-09-30T01:56:00.152748+0000","last_active":"2023-09-30T01:56:00.157391+0000","last_peered":"2023-09-30T01:56:00.157391+0000","last_clean":"2023-09-30T01:56:00.157391+0000","last_became_active":"2023-09-30T01:56:00.152435+0000","last_became_peered":"2023-09-30T01:56:00.152435+0000","last_unstale":"2023-09-30T01:56:00.157391+0000","last_undegraded":"2023-09-30T01:56:00.157391+0000","last_fullsized":"2023-09-30T01:56:00.157391+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:08.611396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150804+0000","last_change":"2023-09-30T01:56:00.148868+0000","last_active":"2023-09-30T01:56:00.150804+0000","last_peered":"2023-09-30T01:56:00.150804+0000","last_clean":"2023-09-30T01:56:00.150804+0000","last_became_active":"2023-09-30T01:56:00.148611+0000","last_became_peered":"2023-09-30T01:56:00.148611+0000","last_unstale":"2023-09-30T01:56:00.150804+0000","last_undegraded":"2023-09-30T01:56:00.150804+0000","last_fullsized":"2023-09-30T01:56:00.150804+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:20:12.451240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143087+0000","last_change":"2023-09-30T01:56:00.137850+0000","last_active":"2023-09-30T01:56:00.143087+0000","last_peered":"2023-09-30T01:56:00.143087+0000","last_clean":"2023-09-30T01:56:00.143087+0000","last_became_active":"2023-09-30T01:56:00.137521+0000","last_became_peered":"2023-09-30T01:56:00.137521+0000","last_unstale":"2023-09-30T01:56:00.143087+0000","last_undegraded":"2023-09-30T01:56:00.143087+0000","last_fullsized":"2023-09-30T01:56:00.143087+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:12:45.050840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155855+0000","last_change":"2023-09-30T01:56:00.152024+0000","last_active":"2023-09-30T01:56:00.155855+0000","last_peered":"2023-09-30T01:56:00.155855+0000","last_clean":"2023-09-30T01:56:00.155855+0000","last_became_active":"2023-09-30T01:56:00.150705+0000","last_became_peered":"2023-09-30T01:56:00.150705+0000","last_unstale":"2023-09-30T01:56:00.155855+0000","last_undegraded":"2023-09-30T01:56:00.155855+0000","last_fullsized":"2023-09-30T01:56:00.155855+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:27:08.978174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.149819+0000","last_change":"2023-09-30T01:56:00.135734+0000","last_active":"2023-09-30T01:56:00.149819+0000","last_peered":"2023-09-30T01:56:00.149819+0000","last_clean":"2023-09-30T01:56:00.149819+0000","last_became_active":"2023-09-30T01:56:00.134747+0000","last_became_peered":"2023-09-30T01:56:00.134747+0000","last_unstale":"2023-09-30T01:56:00.149819+0000","last_undegraded":"2023-09-30T01:56:00.149819+0000","last_fullsized":"2023-09-30T01:56:00.149819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:10:11.219000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143114+0000","last_change":"2023-09-30T01:56:00.138167+0000","last_active":"2023-09-30T01:56:00.143114+0000","last_peered":"2023-09-30T01:56:00.143114+0000","last_clean":"2023-09-30T01:56:00.143114+0000","last_became_active":"2023-09-30T01:56:00.137821+0000","last_became_peered":"2023-09-30T01:56:00.137821+0000","last_unstale":"2023-09-30T01:56:00.143114+0000","last_undegraded":"2023-09-30T01:56:00.143114+0000","last_fullsized":"2023-09-30T01:56:00.143114+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:11:10.730984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150406+0000","last_change":"2023-09-30T01:56:00.138769+0000","last_active":"2023-09-30T01:56:00.150406+0000","last_peered":"2023-09-30T01:56:00.150406+0000","last_clean":"2023-09-30T01:56:00.150406+0000","last_became_active":"2023-09-30T01:56:00.138302+0000","last_became_peered":"2023-09-30T01:56:00.138302+0000","last_unstale":"2023-09-30T01:56:00.150406+0000","last_undegraded":"2023-09-30T01:56:00.150406+0000","last_fullsized":"2023-09-30T01:56:00.150406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:31.820081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148717+0000","last_change":"2023-09-30T01:56:00.145007+0000","last_active":"2023-09-30T01:56:00.148717+0000","last_peered":"2023-09-30T01:56:00.148717+0000","last_clean":"2023-09-30T01:56:00.148717+0000","last_became_active":"2023-09-30T01:56:00.144721+0000","last_became_peered":"2023-09-30T01:56:00.144721+0000","last_unstale":"2023-09-30T01:56:00.148717+0000","last_undegraded":"2023-09-30T01:56:00.148717+0000","last_fullsized":"2023-09-30T01:56:00.148717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:27:08.978174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155951+0000","last_change":"2023-09-30T01:56:00.152139+0000","last_active":"2023-09-30T01:56:00.155951+0000","last_peered":"2023-09-30T01:56:00.155951+0000","last_clean":"2023-09-30T01:56:00.155951+0000","last_became_active":"2023-09-30T01:56:00.150862+0000","last_became_peered":"2023-09-30T01:56:00.150862+0000","last_unstale":"2023-09-30T01:56:00.155951+0000","last_undegraded":"2023-09-30T01:56:00.155951+0000","last_fullsized":"2023-09-30T01:56:00.155951+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:42.194028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157422+0000","last_change":"2023-09-30T01:56:00.154368+0000","last_active":"2023-09-30T01:56:00.157422+0000","last_peered":"2023-09-30T01:56:00.157422+0000","last_clean":"2023-09-30T01:56:00.157422+0000","last_became_active":"2023-09-30T01:56:00.153986+0000","last_became_peered":"2023-09-30T01:56:00.153986+0000","last_unstale":"2023-09-30T01:56:00.157422+0000","last_undegraded":"2023-09-30T01:56:00.157422+0000","last_fullsized":"2023-09-30T01:56:00.157422+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:51:06.725801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142974+0000","last_change":"2023-09-30T01:56:00.136648+0000","last_active":"2023-09-30T01:56:00.142974+0000","last_peered":"2023-09-30T01:56:00.142974+0000","last_clean":"2023-09-30T01:56:00.142974+0000","last_became_active":"2023-09-30T01:56:00.136284+0000","last_became_peered":"2023-09-30T01:56:00.136284+0000","last_unstale":"2023-09-30T01:56:00.142974+0000","last_undegraded":"2023-09-30T01:56:00.142974+0000","last_fullsized":"2023-09-30T01:56:00.142974+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:37.790754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157601+0000","last_change":"2023-09-30T01:56:00.154844+0000","last_active":"2023-09-30T01:56:00.157601+0000","last_peered":"2023-09-30T01:56:00.157601+0000","last_clean":"2023-09-30T01:56:00.157601+0000","last_became_active":"2023-09-30T01:56:00.154532+0000","last_became_peered":"2023-09-30T01:56:00.154532+0000","last_unstale":"2023-09-30T01:56:00.157601+0000","last_undegraded":"2023-09-30T01:56:00.157601+0000","last_fullsized":"2023-09-30T01:56:00.157601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:16:34.209458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.144813+0000","last_change":"2023-09-30T01:55:59.785778+0000","last_active":"2023-09-30T01:56:00.144813+0000","last_peered":"2023-09-30T01:56:00.144813+0000","last_clean":"2023-09-30T01:56:00.144813+0000","last_became_active":"2023-09-30T01:55:59.785425+0000","last_became_peered":"2023-09-30T01:55:59.785425+0000","last_unstale":"2023-09-30T01:56:00.144813+0000","last_undegraded":"2023-09-30T01:56:00.144813+0000","last_fullsized":"2023-09-30T01:56:00.144813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:27:45.755265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148718+0000","last_change":"2023-09-30T01:56:00.144232+0000","last_active":"2023-09-30T01:56:00.148718+0000","last_peered":"2023-09-30T01:56:00.148718+0000","last_clean":"2023-09-30T01:56:00.148718+0000","last_became_active":"2023-09-30T01:56:00.143962+0000","last_became_peered":"2023-09-30T01:56:00.143962+0000","last_unstale":"2023-09-30T01:56:00.148718+0000","last_undegraded":"2023-09-30T01:56:00.148718+0000","last_fullsized":"2023-09-30T01:56:00.148718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:02:54.801532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.114192+0000","last_change":"2023-09-30T01:55:59.782826+0000","last_active":"2023-09-30T01:56:00.114192+0000","last_peered":"2023-09-30T01:56:00.114192+0000","last_clean":"2023-09-30T01:56:00.114192+0000","last_became_active":"2023-09-30T01:55:59.781535+0000","last_became_peered":"2023-09-30T01:55:59.781535+0000","last_unstale":"2023-09-30T01:56:00.114192+0000","last_undegraded":"2023-09-30T01:56:00.114192+0000","last_fullsized":"2023-09-30T01:56:00.114192+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:18:41.601447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157568+0000","last_change":"2023-09-30T01:56:00.154810+0000","last_active":"2023-09-30T01:56:00.157568+0000","last_peered":"2023-09-30T01:56:00.157568+0000","last_clean":"2023-09-30T01:56:00.157568+0000","last_became_active":"2023-09-30T01:56:00.154365+0000","last_became_peered":"2023-09-30T01:56:00.154365+0000","last_unstale":"2023-09-30T01:56:00.157568+0000","last_undegraded":"2023-09-30T01:56:00.157568+0000","last_fullsized":"2023-09-30T01:56:00.157568+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:51:49.277142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127014+0000","last_change":"2023-09-30T01:55:59.787364+0000","last_active":"2023-09-30T01:56:00.127014+0000","last_peered":"2023-09-30T01:56:00.127014+0000","last_clean":"2023-09-30T01:56:00.127014+0000","last_became_active":"2023-09-30T01:55:59.786992+0000","last_became_peered":"2023-09-30T01:55:59.786992+0000","last_unstale":"2023-09-30T01:56:00.127014+0000","last_undegraded":"2023-09-30T01:56:00.127014+0000","last_fullsized":"2023-09-30T01:56:00.127014+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T11:58:52.492307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157531+0000","last_change":"2023-09-30T01:56:00.154700+0000","last_active":"2023-09-30T01:56:00.157531+0000","last_peered":"2023-09-30T01:56:00.157531+0000","last_clean":"2023-09-30T01:56:00.157531+0000","last_became_active":"2023-09-30T01:56:00.154367+0000","last_became_peered":"2023-09-30T01:56:00.154367+0000","last_unstale":"2023-09-30T01:56:00.157531+0000","last_undegraded":"2023-09-30T01:56:00.157531+0000","last_fullsized":"2023-09-30T01:56:00.157531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:45:43.999938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.154011+0000","last_change":"2023-09-30T01:55:59.781281+0000","last_active":"2023-09-30T01:56:00.154011+0000","last_peered":"2023-09-30T01:56:00.154011+0000","last_clean":"2023-09-30T01:56:00.154011+0000","last_became_active":"2023-09-30T01:55:59.780907+0000","last_became_peered":"2023-09-30T01:55:59.780907+0000","last_unstale":"2023-09-30T01:56:00.154011+0000","last_undegraded":"2023-09-30T01:56:00.154011+0000","last_fullsized":"2023-09-30T01:56:00.154011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:54.314374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148023+0000","last_change":"2023-09-30T01:55:59.777405+0000","last_active":"2023-09-30T01:56:00.148023+0000","last_peered":"2023-09-30T01:56:00.148023+0000","last_clean":"2023-09-30T01:56:00.148023+0000","last_became_active":"2023-09-30T01:55:59.777101+0000","last_became_peered":"2023-09-30T01:55:59.777101+0000","last_unstale":"2023-09-30T01:56:00.148023+0000","last_undegraded":"2023-09-30T01:56:00.148023+0000","last_fullsized":"2023-09-30T01:56:00.148023+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:14:32.159800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148667+0000","last_change":"2023-09-30T01:56:00.143954+0000","last_active":"2023-09-30T01:56:00.148667+0000","last_peered":"2023-09-30T01:56:00.148667+0000","last_clean":"2023-09-30T01:56:00.148667+0000","last_became_active":"2023-09-30T01:56:00.143607+0000","last_became_peered":"2023-09-30T01:56:00.143607+0000","last_unstale":"2023-09-30T01:56:00.148667+0000","last_undegraded":"2023-09-30T01:56:00.148667+0000","last_fullsized":"2023-09-30T01:56:00.148667+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:08.611396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142086+0000","last_change":"2023-09-30T01:55:59.772042+0000","last_active":"2023-09-30T01:56:00.142086+0000","last_peered":"2023-09-30T01:56:00.142086+0000","last_clean":"2023-09-30T01:56:00.142086+0000","last_became_active":"2023-09-30T01:55:59.771218+0000","last_became_peered":"2023-09-30T01:55:59.771218+0000","last_unstale":"2023-09-30T01:56:00.142086+0000","last_undegraded":"2023-09-30T01:56:00.142086+0000","last_fullsized":"2023-09-30T01:56:00.142086+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:58:12.527512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.153264+0000","last_change":"2023-09-30T01:56:00.146609+0000","last_active":"2023-09-30T01:56:00.153264+0000","last_peered":"2023-09-30T01:56:00.153264+0000","last_clean":"2023-09-30T01:56:00.153264+0000","last_became_active":"2023-09-30T01:56:00.146051+0000","last_became_peered":"2023-09-30T01:56:00.146051+0000","last_unstale":"2023-09-30T01:56:00.153264+0000","last_undegraded":"2023-09-30T01:56:00.153264+0000","last_fullsized":"2023-09-30T01:56:00.153264+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:29:29.479636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.144756+0000","last_change":"2023-09-30T01:55:59.787370+0000","last_active":"2023-09-30T01:56:00.144756+0000","last_peered":"2023-09-30T01:56:00.144756+0000","last_clean":"2023-09-30T01:56:00.144756+0000","last_became_active":"2023-09-30T01:55:59.787002+0000","last_became_peered":"2023-09-30T01:55:59.787002+0000","last_unstale":"2023-09-30T01:56:00.144756+0000","last_undegraded":"2023-09-30T01:56:00.144756+0000","last_fullsized":"2023-09-30T01:56:00.144756+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:32:49.528387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143061+0000","last_change":"2023-09-30T01:56:00.137829+0000","last_active":"2023-09-30T01:56:00.143061+0000","last_peered":"2023-09-30T01:56:00.143061+0000","last_clean":"2023-09-30T01:56:00.143061+0000","last_became_active":"2023-09-30T01:56:00.137459+0000","last_became_peered":"2023-09-30T01:56:00.137459+0000","last_unstale":"2023-09-30T01:56:00.143061+0000","last_undegraded":"2023-09-30T01:56:00.143061+0000","last_fullsized":"2023-09-30T01:56:00.143061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T13:10:44.425502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.131081+0000","last_change":"2023-09-30T01:55:59.783420+0000","last_active":"2023-09-30T01:56:00.131081+0000","last_peered":"2023-09-30T01:56:00.131081+0000","last_clean":"2023-09-30T01:56:00.131081+0000","last_became_active":"2023-09-30T01:55:59.783204+0000","last_became_peered":"2023-09-30T01:55:59.783204+0000","last_unstale":"2023-09-30T01:56:00.131081+0000","last_undegraded":"2023-09-30T01:56:00.131081+0000","last_fullsized":"2023-09-30T01:56:00.131081+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:24:14.176343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145005+0000","last_change":"2023-09-30T01:56:00.134933+0000","last_active":"2023-09-30T01:56:00.145005+0000","last_peered":"2023-09-30T01:56:00.145005+0000","last_clean":"2023-09-30T01:56:00.145005+0000","last_became_active":"2023-09-30T01:56:00.134644+0000","last_became_peered":"2023-09-30T01:56:00.134644+0000","last_unstale":"2023-09-30T01:56:00.145005+0000","last_undegraded":"2023-09-30T01:56:00.145005+0000","last_fullsized":"2023-09-30T01:56:00.145005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:23.066981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.154766+0000","last_change":"2023-09-30T01:55:59.784616+0000","last_active":"2023-09-30T01:56:00.154766+0000","last_peered":"2023-09-30T01:56:00.154766+0000","last_clean":"2023-09-30T01:56:00.154766+0000","last_became_active":"2023-09-30T01:55:59.782834+0000","last_became_peered":"2023-09-30T01:55:59.782834+0000","last_unstale":"2023-09-30T01:56:00.154766+0000","last_undegraded":"2023-09-30T01:56:00.154766+0000","last_fullsized":"2023-09-30T01:56:00.154766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:51:07.989623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.152818+0000","last_change":"2023-09-30T01:56:00.145655+0000","last_active":"2023-09-30T01:56:00.152818+0000","last_peered":"2023-09-30T01:56:00.152818+0000","last_clean":"2023-09-30T01:56:00.152818+0000","last_became_active":"2023-09-30T01:56:00.145040+0000","last_became_peered":"2023-09-30T01:56:00.145040+0000","last_unstale":"2023-09-30T01:56:00.152818+0000","last_undegraded":"2023-09-30T01:56:00.152818+0000","last_fullsized":"2023-09-30T01:56:00.152818+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:51:49.277142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127154+0000","last_change":"2023-09-30T01:55:59.777347+0000","last_active":"2023-09-30T01:56:00.127154+0000","last_peered":"2023-09-30T01:56:00.127154+0000","last_clean":"2023-09-30T01:56:00.127154+0000","last_became_active":"2023-09-30T01:55:59.777030+0000","last_became_peered":"2023-09-30T01:55:59.777030+0000","last_unstale":"2023-09-30T01:56:00.127154+0000","last_undegraded":"2023-09-30T01:56:00.127154+0000","last_fullsized":"2023-09-30T01:56:00.127154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:20:19.585888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142984+0000","last_change":"2023-09-30T01:56:00.136790+0000","last_active":"2023-09-30T01:56:00.142984+0000","last_peered":"2023-09-30T01:56:00.142984+0000","last_clean":"2023-09-30T01:56:00.142984+0000","last_became_active":"2023-09-30T01:56:00.136433+0000","last_became_peered":"2023-09-30T01:56:00.136433+0000","last_unstale":"2023-09-30T01:56:00.142984+0000","last_undegraded":"2023-09-30T01:56:00.142984+0000","last_fullsized":"2023-09-30T01:56:00.142984+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:05:08.611396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129426+0000","last_change":"2023-09-30T01:55:59.782594+0000","last_active":"2023-09-30T01:56:00.129426+0000","last_peered":"2023-09-30T01:56:00.129426+0000","last_clean":"2023-09-30T01:56:00.129426+0000","last_became_active":"2023-09-30T01:55:59.782293+0000","last_became_peered":"2023-09-30T01:55:59.782293+0000","last_unstale":"2023-09-30T01:56:00.129426+0000","last_undegraded":"2023-09-30T01:56:00.129426+0000","last_fullsized":"2023-09-30T01:56:00.129426+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:17:29.530403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.134113+0000","last_change":"2023-09-30T01:56:00.126377+0000","last_active":"2023-09-30T01:56:00.134113+0000","last_peered":"2023-09-30T01:56:00.134113+0000","last_clean":"2023-09-30T01:56:00.134113+0000","last_became_active":"2023-09-30T01:56:00.125998+0000","last_became_peered":"2023-09-30T01:56:00.125998+0000","last_unstale":"2023-09-30T01:56:00.134113+0000","last_undegraded":"2023-09-30T01:56:00.134113+0000","last_fullsized":"2023-09-30T01:56:00.134113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:58:13.540515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.130011+0000","last_change":"2023-09-30T01:55:59.783826+0000","last_active":"2023-09-30T01:56:00.130011+0000","last_peered":"2023-09-30T01:56:00.130011+0000","last_clean":"2023-09-30T01:56:00.130011+0000","last_became_active":"2023-09-30T01:55:59.783255+0000","last_became_peered":"2023-09-30T01:55:59.783255+0000","last_unstale":"2023-09-30T01:56:00.130011+0000","last_undegraded":"2023-09-30T01:56:00.130011+0000","last_fullsized":"2023-09-30T01:56:00.130011+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:39.893506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155612+0000","last_change":"2023-09-30T01:56:00.149604+0000","last_active":"2023-09-30T01:56:00.155612+0000","last_peered":"2023-09-30T01:56:00.155612+0000","last_clean":"2023-09-30T01:56:00.155612+0000","last_became_active":"2023-09-30T01:56:00.147427+0000","last_became_peered":"2023-09-30T01:56:00.147427+0000","last_unstale":"2023-09-30T01:56:00.155612+0000","last_undegraded":"2023-09-30T01:56:00.155612+0000","last_fullsized":"2023-09-30T01:56:00.155612+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:30:20.150172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"12'117","reported_seq":165,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.121950+0000","last_change":"2023-09-30T01:55:50.454189+0000","last_active":"2023-09-30T01:56:00.121950+0000","last_peered":"2023-09-30T01:56:00.121950+0000","last_clean":"2023-09-30T01:56:00.121950+0000","last_became_active":"2023-09-30T01:55:50.451349+0000","last_became_peered":"2023-09-30T01:55:50.451349+0000","last_unstale":"2023-09-30T01:56:00.121950+0000","last_undegraded":"2023-09-30T01:56:00.121950+0000","last_fullsized":"2023-09-30T01:56:00.121950+0000","mapping_epoch":10,"log_start":"0'0","ondisk_log_start":"0'0","created":10,"last_epoch_clean":11,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:49.223709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:49.223709+0000","last_clean_scrub_stamp":"2023-09-30T01:55:49.223709+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:14:10.620817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127411+0000","last_change":"2023-09-30T01:55:55.596984+0000","last_active":"2023-09-30T01:56:00.127411+0000","last_peered":"2023-09-30T01:56:00.127411+0000","last_clean":"2023-09-30T01:56:00.127411+0000","last_became_active":"2023-09-30T01:55:55.596422+0000","last_became_peered":"2023-09-30T01:55:55.596422+0000","last_unstale":"2023-09-30T01:56:00.127411+0000","last_undegraded":"2023-09-30T01:56:00.127411+0000","last_fullsized":"2023-09-30T01:56:00.127411+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:37:25.143805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.128684+0000","last_change":"2023-09-30T01:55:59.783410+0000","last_active":"2023-09-30T01:56:00.128684+0000","last_peered":"2023-09-30T01:56:00.128684+0000","last_clean":"2023-09-30T01:56:00.128684+0000","last_became_active":"2023-09-30T01:55:59.783095+0000","last_became_peered":"2023-09-30T01:55:59.783095+0000","last_unstale":"2023-09-30T01:56:00.128684+0000","last_undegraded":"2023-09-30T01:56:00.128684+0000","last_fullsized":"2023-09-30T01:56:00.128684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:56:41.268990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150125+0000","last_change":"2023-09-30T01:56:00.148605+0000","last_active":"2023-09-30T01:56:00.150125+0000","last_peered":"2023-09-30T01:56:00.150125+0000","last_clean":"2023-09-30T01:56:00.150125+0000","last_became_active":"2023-09-30T01:56:00.148253+0000","last_became_peered":"2023-09-30T01:56:00.148253+0000","last_unstale":"2023-09-30T01:56:00.150125+0000","last_undegraded":"2023-09-30T01:56:00.150125+0000","last_fullsized":"2023-09-30T01:56:00.150125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:34:19.920224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.132428+0000","last_change":"2023-09-30T01:55:55.599574+0000","last_active":"2023-09-30T01:56:00.132428+0000","last_peered":"2023-09-30T01:56:00.132428+0000","last_clean":"2023-09-30T01:56:00.132428+0000","last_became_active":"2023-09-30T01:55:55.598970+0000","last_became_peered":"2023-09-30T01:55:55.598970+0000","last_unstale":"2023-09-30T01:56:00.132428+0000","last_undegraded":"2023-09-30T01:56:00.132428+0000","last_fullsized":"2023-09-30T01:56:00.132428+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:41:53.195170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.121970+0000","last_change":"2023-09-30T01:55:59.769829+0000","last_active":"2023-09-30T01:56:00.121970+0000","last_peered":"2023-09-30T01:56:00.121970+0000","last_clean":"2023-09-30T01:56:00.121970+0000","last_became_active":"2023-09-30T01:55:59.769519+0000","last_became_peered":"2023-09-30T01:55:59.769519+0000","last_unstale":"2023-09-30T01:56:00.121970+0000","last_undegraded":"2023-09-30T01:56:00.121970+0000","last_fullsized":"2023-09-30T01:56:00.121970+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:27:45.755265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157448+0000","last_change":"2023-09-30T01:56:00.154436+0000","last_active":"2023-09-30T01:56:00.157448+0000","last_peered":"2023-09-30T01:56:00.157448+0000","last_clean":"2023-09-30T01:56:00.157448+0000","last_became_active":"2023-09-30T01:56:00.154030+0000","last_became_peered":"2023-09-30T01:56:00.154030+0000","last_unstale":"2023-09-30T01:56:00.157448+0000","last_undegraded":"2023-09-30T01:56:00.157448+0000","last_fullsized":"2023-09-30T01:56:00.157448+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:48:07.197805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.114706+0000","last_change":"2023-09-30T01:55:56.090039+0000","last_active":"2023-09-30T01:56:00.114706+0000","last_peered":"2023-09-30T01:56:00.114706+0000","last_clean":"2023-09-30T01:56:00.114706+0000","last_became_active":"2023-09-30T01:55:56.089292+0000","last_became_peered":"2023-09-30T01:55:56.089292+0000","last_unstale":"2023-09-30T01:56:00.114706+0000","last_undegraded":"2023-09-30T01:56:00.114706+0000","last_fullsized":"2023-09-30T01:56:00.114706+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:04:26.068674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.122368+0000","last_change":"2023-09-30T01:55:59.768182+0000","last_active":"2023-09-30T01:56:00.122368+0000","last_peered":"2023-09-30T01:56:00.122368+0000","last_clean":"2023-09-30T01:56:00.122368+0000","last_became_active":"2023-09-30T01:55:59.767808+0000","last_became_peered":"2023-09-30T01:55:59.767808+0000","last_unstale":"2023-09-30T01:56:00.122368+0000","last_undegraded":"2023-09-30T01:56:00.122368+0000","last_fullsized":"2023-09-30T01:56:00.122368+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:50:39.919553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.152919+0000","last_change":"2023-09-30T01:56:00.146334+0000","last_active":"2023-09-30T01:56:00.152919+0000","last_peered":"2023-09-30T01:56:00.152919+0000","last_clean":"2023-09-30T01:56:00.152919+0000","last_became_active":"2023-09-30T01:56:00.146038+0000","last_became_peered":"2023-09-30T01:56:00.146038+0000","last_unstale":"2023-09-30T01:56:00.152919+0000","last_undegraded":"2023-09-30T01:56:00.152919+0000","last_fullsized":"2023-09-30T01:56:00.152919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:32:23.254275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127237+0000","last_change":"2023-09-30T01:55:55.600117+0000","last_active":"2023-09-30T01:56:00.127237+0000","last_peered":"2023-09-30T01:56:00.127237+0000","last_clean":"2023-09-30T01:56:00.127237+0000","last_became_active":"2023-09-30T01:55:55.599019+0000","last_became_peered":"2023-09-30T01:55:55.599019+0000","last_unstale":"2023-09-30T01:56:00.127237+0000","last_undegraded":"2023-09-30T01:56:00.127237+0000","last_fullsized":"2023-09-30T01:56:00.127237+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:18:37.420194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.127301+0000","last_change":"2023-09-30T01:55:59.777990+0000","last_active":"2023-09-30T01:56:00.127301+0000","last_peered":"2023-09-30T01:56:00.127301+0000","last_clean":"2023-09-30T01:56:00.127301+0000","last_became_active":"2023-09-30T01:55:59.777675+0000","last_became_peered":"2023-09-30T01:55:59.777675+0000","last_unstale":"2023-09-30T01:56:00.127301+0000","last_undegraded":"2023-09-30T01:56:00.127301+0000","last_fullsized":"2023-09-30T01:56:00.127301+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:26:30.591338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150426+0000","last_change":"2023-09-30T01:56:00.139198+0000","last_active":"2023-09-30T01:56:00.150426+0000","last_peered":"2023-09-30T01:56:00.150426+0000","last_clean":"2023-09-30T01:56:00.150426+0000","last_became_active":"2023-09-30T01:56:00.138489+0000","last_became_peered":"2023-09-30T01:56:00.138489+0000","last_unstale":"2023-09-30T01:56:00.150426+0000","last_undegraded":"2023-09-30T01:56:00.150426+0000","last_fullsized":"2023-09-30T01:56:00.150426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T12:20:12.451240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129721+0000","last_change":"2023-09-30T01:55:59.785288+0000","last_active":"2023-09-30T01:56:00.129721+0000","last_peered":"2023-09-30T01:56:00.129721+0000","last_clean":"2023-09-30T01:56:00.129721+0000","last_became_active":"2023-09-30T01:55:59.784897+0000","last_became_peered":"2023-09-30T01:55:59.784897+0000","last_unstale":"2023-09-30T01:56:00.129721+0000","last_undegraded":"2023-09-30T01:56:00.129721+0000","last_fullsized":"2023-09-30T01:56:00.129721+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:30:34.537681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.128920+0000","last_change":"2023-09-30T01:55:56.090103+0000","last_active":"2023-09-30T01:56:00.128920+0000","last_peered":"2023-09-30T01:56:00.128920+0000","last_clean":"2023-09-30T01:56:00.128920+0000","last_became_active":"2023-09-30T01:55:56.089319+0000","last_became_peered":"2023-09-30T01:55:56.089319+0000","last_unstale":"2023-09-30T01:56:00.128920+0000","last_undegraded":"2023-09-30T01:56:00.128920+0000","last_fullsized":"2023-09-30T01:56:00.128920+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:29.888440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157373+0000","last_change":"2023-09-30T01:56:00.152652+0000","last_active":"2023-09-30T01:56:00.157373+0000","last_peered":"2023-09-30T01:56:00.157373+0000","last_clean":"2023-09-30T01:56:00.157373+0000","last_became_active":"2023-09-30T01:56:00.152301+0000","last_became_peered":"2023-09-30T01:56:00.152301+0000","last_unstale":"2023-09-30T01:56:00.157373+0000","last_undegraded":"2023-09-30T01:56:00.157373+0000","last_fullsized":"2023-09-30T01:56:00.157373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:37:37.790754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.122972+0000","last_change":"2023-09-30T01:55:59.768001+0000","last_active":"2023-09-30T01:56:00.122972+0000","last_peered":"2023-09-30T01:56:00.122972+0000","last_clean":"2023-09-30T01:56:00.122972+0000","last_became_active":"2023-09-30T01:55:59.767723+0000","last_became_peered":"2023-09-30T01:55:59.767723+0000","last_unstale":"2023-09-30T01:56:00.122972+0000","last_undegraded":"2023-09-30T01:56:00.122972+0000","last_fullsized":"2023-09-30T01:56:00.122972+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:08:09.194250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129835+0000","last_change":"2023-09-30T01:55:55.597415+0000","last_active":"2023-09-30T01:56:00.129835+0000","last_peered":"2023-09-30T01:56:00.129835+0000","last_clean":"2023-09-30T01:56:00.129835+0000","last_became_active":"2023-09-30T01:55:55.596836+0000","last_became_peered":"2023-09-30T01:55:55.596836+0000","last_unstale":"2023-09-30T01:56:00.129835+0000","last_undegraded":"2023-09-30T01:56:00.129835+0000","last_fullsized":"2023-09-30T01:56:00.129835+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:04:29.888440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.153282+0000","last_change":"2023-09-30T01:56:00.147047+0000","last_active":"2023-09-30T01:56:00.153282+0000","last_peered":"2023-09-30T01:56:00.153282+0000","last_clean":"2023-09-30T01:56:00.153282+0000","last_became_active":"2023-09-30T01:56:00.146771+0000","last_became_peered":"2023-09-30T01:56:00.146771+0000","last_unstale":"2023-09-30T01:56:00.153282+0000","last_undegraded":"2023-09-30T01:56:00.153282+0000","last_fullsized":"2023-09-30T01:56:00.153282+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:34:19.920224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.154263+0000","last_change":"2023-09-30T01:55:59.786446+0000","last_active":"2023-09-30T01:56:00.154263+0000","last_peered":"2023-09-30T01:56:00.154263+0000","last_clean":"2023-09-30T01:56:00.154263+0000","last_became_active":"2023-09-30T01:55:59.786162+0000","last_became_peered":"2023-09-30T01:55:59.786162+0000","last_unstale":"2023-09-30T01:56:00.154263+0000","last_undegraded":"2023-09-30T01:56:00.154263+0000","last_fullsized":"2023-09-30T01:56:00.154263+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:45:19.318729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.123255+0000","last_change":"2023-09-30T01:55:55.597920+0000","last_active":"2023-09-30T01:56:00.123255+0000","last_peered":"2023-09-30T01:56:00.123255+0000","last_clean":"2023-09-30T01:56:00.123255+0000","last_became_active":"2023-09-30T01:55:55.597433+0000","last_became_peered":"2023-09-30T01:55:55.597433+0000","last_unstale":"2023-09-30T01:56:00.123255+0000","last_undegraded":"2023-09-30T01:56:00.123255+0000","last_fullsized":"2023-09-30T01:56:00.123255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:11:56.914296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157594+0000","last_change":"2023-09-30T01:56:00.154867+0000","last_active":"2023-09-30T01:56:00.157594+0000","last_peered":"2023-09-30T01:56:00.157594+0000","last_clean":"2023-09-30T01:56:00.157594+0000","last_became_active":"2023-09-30T01:56:00.154091+0000","last_became_peered":"2023-09-30T01:56:00.154091+0000","last_unstale":"2023-09-30T01:56:00.157594+0000","last_undegraded":"2023-09-30T01:56:00.157594+0000","last_fullsized":"2023-09-30T01:56:00.157594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:10:11.219000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-09-30T01:56:02.976593+0000","last_change":"2023-09-30T01:55:59.774863+0000","last_active":"2023-09-30T01:56:02.976593+0000","last_peered":"2023-09-30T01:56:02.976593+0000","last_clean":"2023-09-30T01:56:02.976593+0000","last_became_active":"2023-09-30T01:55:59.774177+0000","last_became_peered":"2023-09-30T01:55:59.774177+0000","last_unstale":"2023-09-30T01:56:02.976593+0000","last_undegraded":"2023-09-30T01:56:02.976593+0000","last_fullsized":"2023-09-30T01:56:02.976593+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:41:38.413142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129713+0000","last_change":"2023-09-30T01:55:55.599569+0000","last_active":"2023-09-30T01:56:00.129713+0000","last_peered":"2023-09-30T01:56:00.129713+0000","last_clean":"2023-09-30T01:56:00.129713+0000","last_became_active":"2023-09-30T01:55:55.599037+0000","last_became_peered":"2023-09-30T01:55:55.599037+0000","last_unstale":"2023-09-30T01:56:00.129713+0000","last_undegraded":"2023-09-30T01:56:00.129713+0000","last_fullsized":"2023-09-30T01:56:00.129713+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:54.536395+0000","last_clean_scrub_stamp":"2023-09-30T01:55:54.536395+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:03:37.621500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.134188+0000","last_change":"2023-09-30T01:56:00.126614+0000","last_active":"2023-09-30T01:56:00.134188+0000","last_peered":"2023-09-30T01:56:00.134188+0000","last_clean":"2023-09-30T01:56:00.134188+0000","last_became_active":"2023-09-30T01:56:00.126138+0000","last_became_peered":"2023-09-30T01:56:00.126138+0000","last_unstale":"2023-09-30T01:56:00.134188+0000","last_undegraded":"2023-09-30T01:56:00.134188+0000","last_fullsized":"2023-09-30T01:56:00.134188+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:23:55.327377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.135607+0000","last_change":"2023-09-30T01:56:00.126588+0000","last_active":"2023-09-30T01:56:00.135607+0000","last_peered":"2023-09-30T01:56:00.135607+0000","last_clean":"2023-09-30T01:56:00.135607+0000","last_became_active":"2023-09-30T01:56:00.126004+0000","last_became_peered":"2023-09-30T01:56:00.126004+0000","last_unstale":"2023-09-30T01:56:00.135607+0000","last_undegraded":"2023-09-30T01:56:00.135607+0000","last_fullsized":"2023-09-30T01:56:00.135607+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:41:39.426145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"18'6","reported_seq":16,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.149154+0000","last_change":"2023-09-30T01:55:59.772026+0000","last_active":"2023-09-30T01:56:00.149154+0000","last_peered":"2023-09-30T01:56:00.149154+0000","last_clean":"2023-09-30T01:56:00.149154+0000","last_became_active":"2023-09-30T01:55:59.771159+0000","last_became_peered":"2023-09-30T01:55:59.771159+0000","last_unstale":"2023-09-30T01:56:00.149154+0000","last_undegraded":"2023-09-30T01:56:00.149154+0000","last_fullsized":"2023-09-30T01:56:00.149154+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T07:06:00.627501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155934+0000","last_change":"2023-09-30T01:56:00.152010+0000","last_active":"2023-09-30T01:56:00.155934+0000","last_peered":"2023-09-30T01:56:00.155934+0000","last_clean":"2023-09-30T01:56:00.155934+0000","last_became_active":"2023-09-30T01:56:00.150656+0000","last_became_peered":"2023-09-30T01:56:00.150656+0000","last_unstale":"2023-09-30T01:56:00.155934+0000","last_undegraded":"2023-09-30T01:56:00.155934+0000","last_fullsized":"2023-09-30T01:56:00.155934+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:32:22.927822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.141536+0000","last_change":"2023-09-30T01:55:59.780797+0000","last_active":"2023-09-30T01:56:00.141536+0000","last_peered":"2023-09-30T01:56:00.141536+0000","last_clean":"2023-09-30T01:56:00.141536+0000","last_became_active":"2023-09-30T01:55:59.780499+0000","last_became_peered":"2023-09-30T01:55:59.780499+0000","last_unstale":"2023-09-30T01:56:00.141536+0000","last_undegraded":"2023-09-30T01:56:00.141536+0000","last_fullsized":"2023-09-30T01:56:00.141536+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:03:41.802753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.128419+0000","last_change":"2023-09-30T01:55:59.781249+0000","last_active":"2023-09-30T01:56:00.128419+0000","last_peered":"2023-09-30T01:56:00.128419+0000","last_clean":"2023-09-30T01:56:00.128419+0000","last_became_active":"2023-09-30T01:55:59.780891+0000","last_became_peered":"2023-09-30T01:55:59.780891+0000","last_unstale":"2023-09-30T01:56:00.128419+0000","last_undegraded":"2023-09-30T01:56:00.128419+0000","last_fullsized":"2023-09-30T01:56:00.128419+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:40:23.099697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148788+0000","last_change":"2023-09-30T01:56:00.143575+0000","last_active":"2023-09-30T01:56:00.148788+0000","last_peered":"2023-09-30T01:56:00.148788+0000","last_clean":"2023-09-30T01:56:00.148788+0000","last_became_active":"2023-09-30T01:56:00.143091+0000","last_became_peered":"2023-09-30T01:56:00.143091+0000","last_unstale":"2023-09-30T01:56:00.148788+0000","last_undegraded":"2023-09-30T01:56:00.148788+0000","last_fullsized":"2023-09-30T01:56:00.148788+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:09:42.194028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.131397+0000","last_change":"2023-09-30T01:55:59.774448+0000","last_active":"2023-09-30T01:56:00.131397+0000","last_peered":"2023-09-30T01:56:00.131397+0000","last_clean":"2023-09-30T01:56:00.131397+0000","last_became_active":"2023-09-30T01:55:59.774120+0000","last_became_peered":"2023-09-30T01:55:59.774120+0000","last_unstale":"2023-09-30T01:56:00.131397+0000","last_undegraded":"2023-09-30T01:56:00.131397+0000","last_fullsized":"2023-09-30T01:56:00.131397+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:26:30.591338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157610+0000","last_change":"2023-09-30T01:56:00.154894+0000","last_active":"2023-09-30T01:56:00.157610+0000","last_peered":"2023-09-30T01:56:00.157610+0000","last_clean":"2023-09-30T01:56:00.157610+0000","last_became_active":"2023-09-30T01:56:00.154551+0000","last_became_peered":"2023-09-30T01:56:00.154551+0000","last_unstale":"2023-09-30T01:56:00.157610+0000","last_undegraded":"2023-09-30T01:56:00.157610+0000","last_fullsized":"2023-09-30T01:56:00.157610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:59:31.820081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145272+0000","last_change":"2023-09-30T01:56:00.143924+0000","last_active":"2023-09-30T01:56:00.145272+0000","last_peered":"2023-09-30T01:56:00.145272+0000","last_clean":"2023-09-30T01:56:00.145272+0000","last_became_active":"2023-09-30T01:56:00.143739+0000","last_became_peered":"2023-09-30T01:56:00.143739+0000","last_unstale":"2023-09-30T01:56:00.145272+0000","last_undegraded":"2023-09-30T01:56:00.145272+0000","last_fullsized":"2023-09-30T01:56:00.145272+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T08:16:47.636345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.129425+0000","last_change":"2023-09-30T01:55:59.784068+0000","last_active":"2023-09-30T01:56:00.129425+0000","last_peered":"2023-09-30T01:56:00.129425+0000","last_clean":"2023-09-30T01:56:00.129425+0000","last_became_active":"2023-09-30T01:55:59.783547+0000","last_became_peered":"2023-09-30T01:55:59.783547+0000","last_unstale":"2023-09-30T01:56:00.129425+0000","last_undegraded":"2023-09-30T01:56:00.129425+0000","last_fullsized":"2023-09-30T01:56:00.129425+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:50:39.919553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.155902+0000","last_change":"2023-09-30T01:56:00.151969+0000","last_active":"2023-09-30T01:56:00.155902+0000","last_peered":"2023-09-30T01:56:00.155902+0000","last_clean":"2023-09-30T01:56:00.155902+0000","last_became_active":"2023-09-30T01:56:00.150744+0000","last_became_peered":"2023-09-30T01:56:00.150744+0000","last_unstale":"2023-09-30T01:56:00.155902+0000","last_undegraded":"2023-09-30T01:56:00.155902+0000","last_fullsized":"2023-09-30T01:56:00.155902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T03:02:54.801532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.121874+0000","last_change":"2023-09-30T01:55:59.783093+0000","last_active":"2023-09-30T01:56:00.121874+0000","last_peered":"2023-09-30T01:56:00.121874+0000","last_clean":"2023-09-30T01:56:00.121874+0000","last_became_active":"2023-09-30T01:55:59.782532+0000","last_became_peered":"2023-09-30T01:55:59.782532+0000","last_unstale":"2023-09-30T01:56:00.121874+0000","last_undegraded":"2023-09-30T01:56:00.121874+0000","last_fullsized":"2023-09-30T01:56:00.121874+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:34:22.053979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.157524+0000","last_change":"2023-09-30T01:56:00.154425+0000","last_active":"2023-09-30T01:56:00.157524+0000","last_peered":"2023-09-30T01:56:00.157524+0000","last_clean":"2023-09-30T01:56:00.157524+0000","last_became_active":"2023-09-30T01:56:00.153913+0000","last_became_peered":"2023-09-30T01:56:00.153913+0000","last_unstale":"2023-09-30T01:56:00.157524+0000","last_undegraded":"2023-09-30T01:56:00.157524+0000","last_fullsized":"2023-09-30T01:56:00.157524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:32:22.927822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.147919+0000","last_change":"2023-09-30T01:55:59.781339+0000","last_active":"2023-09-30T01:56:00.147919+0000","last_peered":"2023-09-30T01:56:00.147919+0000","last_clean":"2023-09-30T01:56:00.147919+0000","last_became_active":"2023-09-30T01:55:59.780916+0000","last_became_peered":"2023-09-30T01:55:59.780916+0000","last_unstale":"2023-09-30T01:56:00.147919+0000","last_undegraded":"2023-09-30T01:56:00.147919+0000","last_fullsized":"2023-09-30T01:56:00.147919+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:16:33.196455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145239+0000","last_change":"2023-09-30T01:56:00.135640+0000","last_active":"2023-09-30T01:56:00.145239+0000","last_peered":"2023-09-30T01:56:00.145239+0000","last_clean":"2023-09-30T01:56:00.145239+0000","last_became_active":"2023-09-30T01:56:00.135362+0000","last_became_peered":"2023-09-30T01:56:00.135362+0000","last_unstale":"2023-09-30T01:56:00.145239+0000","last_undegraded":"2023-09-30T01:56:00.145239+0000","last_fullsized":"2023-09-30T01:56:00.145239+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:08:10.207253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.144433+0000","last_change":"2023-09-30T01:55:59.783858+0000","last_active":"2023-09-30T01:56:00.144433+0000","last_peered":"2023-09-30T01:56:00.144433+0000","last_clean":"2023-09-30T01:56:00.144433+0000","last_became_active":"2023-09-30T01:55:59.782368+0000","last_became_peered":"2023-09-30T01:55:59.782368+0000","last_unstale":"2023-09-30T01:56:00.144433+0000","last_undegraded":"2023-09-30T01:56:00.144433+0000","last_fullsized":"2023-09-30T01:56:00.144433+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:08:09.194250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.146297+0000","last_change":"2023-09-30T01:56:00.141317+0000","last_active":"2023-09-30T01:56:00.146297+0000","last_peered":"2023-09-30T01:56:00.146297+0000","last_clean":"2023-09-30T01:56:00.146297+0000","last_became_active":"2023-09-30T01:56:00.141087+0000","last_became_peered":"2023-09-30T01:56:00.141087+0000","last_unstale":"2023-09-30T01:56:00.146297+0000","last_undegraded":"2023-09-30T01:56:00.146297+0000","last_fullsized":"2023-09-30T01:56:00.146297+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:24:26.401425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.147345+0000","last_change":"2023-09-30T01:55:59.782826+0000","last_active":"2023-09-30T01:56:00.147345+0000","last_peered":"2023-09-30T01:56:00.147345+0000","last_clean":"2023-09-30T01:56:00.147345+0000","last_became_active":"2023-09-30T01:55:59.782495+0000","last_became_peered":"2023-09-30T01:55:59.782495+0000","last_unstale":"2023-09-30T01:56:00.147345+0000","last_undegraded":"2023-09-30T01:56:00.147345+0000","last_fullsized":"2023-09-30T01:56:00.147345+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T05:56:41.268990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.143147+0000","last_change":"2023-09-30T01:56:00.138415+0000","last_active":"2023-09-30T01:56:00.143147+0000","last_peered":"2023-09-30T01:56:00.143147+0000","last_clean":"2023-09-30T01:56:00.143147+0000","last_became_active":"2023-09-30T01:56:00.137941+0000","last_became_peered":"2023-09-30T01:56:00.137941+0000","last_unstale":"2023-09-30T01:56:00.143147+0000","last_undegraded":"2023-09-30T01:56:00.143147+0000","last_fullsized":"2023-09-30T01:56:00.143147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:08:55.103499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1d","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.142155+0000","last_change":"2023-09-30T01:55:59.776546+0000","last_active":"2023-09-30T01:56:00.142155+0000","last_peered":"2023-09-30T01:56:00.142155+0000","last_clean":"2023-09-30T01:56:00.142155+0000","last_became_active":"2023-09-30T01:55:59.776242+0000","last_became_peered":"2023-09-30T01:55:59.776242+0000","last_unstale":"2023-09-30T01:56:00.142155+0000","last_undegraded":"2023-09-30T01:56:00.142155+0000","last_fullsized":"2023-09-30T01:56:00.142155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T10:24:25.388422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.148797+0000","last_change":"2023-09-30T01:56:00.143686+0000","last_active":"2023-09-30T01:56:00.148797+0000","last_peered":"2023-09-30T01:56:00.148797+0000","last_clean":"2023-09-30T01:56:00.148797+0000","last_became_active":"2023-09-30T01:56:00.143388+0000","last_became_peered":"2023-09-30T01:56:00.143388+0000","last_unstale":"2023-09-30T01:56:00.148797+0000","last_undegraded":"2023-09-30T01:56:00.148797+0000","last_fullsized":"2023-09-30T01:56:00.148797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T02:55:57.453826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145902+0000","last_change":"2023-09-30T01:55:59.786229+0000","last_active":"2023-09-30T01:56:00.145902+0000","last_peered":"2023-09-30T01:56:00.145902+0000","last_clean":"2023-09-30T01:56:00.145902+0000","last_became_active":"2023-09-30T01:55:59.785944+0000","last_became_peered":"2023-09-30T01:55:59.785944+0000","last_unstale":"2023-09-30T01:56:00.145902+0000","last_undegraded":"2023-09-30T01:56:00.145902+0000","last_fullsized":"2023-09-30T01:56:00.145902+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T04:23:52.565054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.150643+0000","last_change":"2023-09-30T01:56:00.148962+0000","last_active":"2023-09-30T01:56:00.150643+0000","last_peered":"2023-09-30T01:56:00.150643+0000","last_clean":"2023-09-30T01:56:00.150643+0000","last_became_active":"2023-09-30T01:56:00.147919+0000","last_became_peered":"2023-09-30T01:56:00.147919+0000","last_unstale":"2023-09-30T01:56:00.150643+0000","last_undegraded":"2023-09-30T01:56:00.150643+0000","last_fullsized":"2023-09-30T01:56:00.150643+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:59.730651+0000","last_clean_scrub_stamp":"2023-09-30T01:55:59.730651+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T09:29:29.479636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2023-09-30T01:56:00.145517+0000","last_change":"2023-09-30T01:55:59.769801+0000","last_active":"2023-09-30T01:56:00.145517+0000","last_peered":"2023-09-30T01:56:00.145517+0000","last_clean":"2023-09-30T01:56:00.145517+0000","last_became_active":"2023-09-30T01:55:59.769503+0000","last_became_peered":"2023-09-30T01:55:59.769503+0000","last_unstale":"2023-09-30T01:56:00.145517+0000","last_undegraded":"2023-09-30T01:56:00.145517+0000","last_fullsized":"2023-09-30T01:56:00.145517+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-09-30T01:55:58.717648+0000","last_clean_scrub_stamp":"2023-09-30T01:55:58.717648+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-01T06:45:38.723185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705672,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8128,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":7936,"kb_avail":94363712,"statfs":{"total":96636764160,"available":96628441088,"internally_reserved":0,"allocated":188416,"data_stored":60567,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8126464},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73599999999999999}]}]},{"osd":2,"up_from":9,"seq":38654705673,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9096,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":8320,"kb_avail":94362744,"statfs":{"total":96636764160,"available":96627449856,"internally_reserved":0,"allocated":786432,"data_stored":652110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8519680},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66200000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705672,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":9152,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":8384,"kb_avail":94362688,"statfs":{"total":96636764160,"available":96627392512,"internally_reserved":0,"allocated":778240,"data_stored":651317,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":8585216},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":0,"up_from":9,"seq":38654705671,"num_pgs":59,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":12232,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":12032,"kb_avail":94359608,"statfs":{"total":96636764160,"available":96624238592,"internally_reserved":0,"allocated":196608,"data_stored":61224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":12320768},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2180,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-09-30T01:56:11.436 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-09-30T01:56:11.436 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-09-30T01:56:11.436 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-09-30T01:56:11.436 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:11.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f25596a2700 1 Processor -- start 2023-09-30T01:56:11.574 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f25596a2700 1 -- start start 2023-09-30T01:56:11.575 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f25596a2700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25540a9130 0x7f255406b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:11.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f25596a2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f25540a3d70 0x7f25540a4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:11.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f25596a2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25540a38e0 con 0x7f2554136030 2023-09-30T01:56:11.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f25596a2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f255406bae0 con 0x7f25540a3d70 2023-09-30T01:56:11.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f25596a2700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25540a69c0 con 0x7f25540a9130 2023-09-30T01:56:11.576 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f2553fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25540a9130 0x7f255406b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:11.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f2553fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25540a9130 0x7f255406b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:44026/0 (socket says 172.21.15.55:44026) 2023-09-30T01:56:11.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f25537fe700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f25540a3d70 0x7f25540a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:11.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f2553fff700 1 -- 172.21.15.55:0/2308035308 learned_addr learned my addr 172.21.15.55:0/2308035308 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:11.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f2553fff700 1 -- 172.21.15.55:0/2308035308 >> v2:172.21.15.133:3300/0 conn(0x7f25540a3d70 msgr2=0x7f25540a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:11.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f2553fff700 1 --2- 172.21.15.55:0/2308035308 >> v2:172.21.15.133:3300/0 conn(0x7f25540a3d70 0x7f25540a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f2553fff700 1 -- 172.21.15.55:0/2308035308 >> v1:172.21.15.133:6789/0 conn(0x7f2554136030 legacy=0x7f2554136490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.577 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f2553fff700 1 -- 172.21.15.55:0/2308035308 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25540a9500 con 0x7f25540a9130 2023-09-30T01:56:11.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f2553fff700 1 --2- 172.21.15.55:0/2308035308 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25540a9130 0x7f255406b5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f25480099b0 tx=0x7f2548009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c278bd760001e83 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:11.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f2552ffd700 1 -- 172.21.15.55:0/2308035308 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2548009ea0 con 0x7f25540a9130 2023-09-30T01:56:11.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f2552ffd700 1 -- 172.21.15.55:0/2308035308 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254800b860 con 0x7f25540a9130 2023-09-30T01:56:11.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.571+0000 7f2552ffd700 1 -- 172.21.15.55:0/2308035308 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254800bc00 con 0x7f25540a9130 2023-09-30T01:56:11.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.575+0000 7f25596a2700 1 -- 172.21.15.55:0/2308035308 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25540a9130 msgr2=0x7f255406b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.575+0000 7f25596a2700 1 --2- 172.21.15.55:0/2308035308 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25540a9130 0x7f255406b5a0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f25480099b0 tx=0x7f2548009250 comp rx=0 tx=0).stop 2023-09-30T01:56:11.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.575+0000 7f25596a2700 1 -- 172.21.15.55:0/2308035308 shutdown_connections 2023-09-30T01:56:11.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.575+0000 7f25596a2700 1 --2- 172.21.15.55:0/2308035308 >> v2:172.21.15.133:3300/0 conn(0x7f25540a3d70 0x7f25540a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.575+0000 7f25596a2700 1 --2- 172.21.15.55:0/2308035308 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25540a9130 0x7f255406b5a0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.575+0000 7f25596a2700 1 -- 172.21.15.55:0/2308035308 >> 172.21.15.55:0/2308035308 conn(0x7f25540b6940 msgr2=0x7f25540b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:11.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.575+0000 7f25596a2700 1 -- 172.21.15.55:0/2308035308 shutdown_connections 2023-09-30T01:56:11.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.575+0000 7f25596a2700 1 -- 172.21.15.55:0/2308035308 wait complete. 2023-09-30T01:56:11.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.575+0000 7f25596a2700 1 Processor -- start 2023-09-30T01:56:11.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.575+0000 7f25596a2700 1 -- start start 2023-09-30T01:56:11.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.575+0000 7f25596a2700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25540a3d70 0x7f25540a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:11.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.575+0000 7f25596a2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25540a9130 0x7f2554131750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:11.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f25596a2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2554136030 0x7f255406cf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:11.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f25596a2700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2554130650 con 0x7f2554136030 2023-09-30T01:56:11.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f25596a2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2554130d60 con 0x7f25540a9130 2023-09-30T01:56:11.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f25596a2700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f255406db90 con 0x7f25540a3d70 2023-09-30T01:56:11.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f2553fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25540a3d70 0x7f25540a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:11.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f2558ea1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2554136030 0x7f255406cf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:11.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f2553fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25540a3d70 0x7f25540a7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:44040/0 (socket says 172.21.15.55:44040) 2023-09-30T01:56:11.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f2553fff700 1 -- 172.21.15.55:0/4258029571 learned_addr learned my addr 172.21.15.55:0/4258029571 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:11.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f25537fe700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25540a9130 0x7f2554131750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:11.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f2558ea1700 1 -- 172.21.15.55:0/4258029571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25540a3d70 msgr2=0x7f25540a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f2558ea1700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25540a3d70 0x7f25540a7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f2558ea1700 1 -- 172.21.15.55:0/4258029571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25540a9130 msgr2=0x7f2554131750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f2558ea1700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25540a9130 0x7f2554131750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f2558ea1700 1 -- 172.21.15.55:0/4258029571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25480094f0 con 0x7f2554136030 2023-09-30T01:56:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f25537fe700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25540a9130 0x7f2554131750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f2553fff700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25540a3d70 0x7f25540a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f2558ea1700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2554136030 0x7f255406cf00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f254c00c790 tx=0x7f254c0015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f253bfff700 1 -- 172.21.15.55:0/4258029571 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c012630 con 0x7f2554136030 2023-09-30T01:56:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f253bfff700 1 -- 172.21.15.55:0/4258029571 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f254c0127b0 con 0x7f2554136030 2023-09-30T01:56:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f25596a2700 1 -- 172.21.15.55:0/4258029571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f255406de50 con 0x7f2554136030 2023-09-30T01:56:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f253bfff700 1 -- 172.21.15.55:0/4258029571 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f254c012b70 con 0x7f2554136030 2023-09-30T01:56:11.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f25596a2700 1 -- 172.21.15.55:0/4258029571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f255406d440 con 0x7f2554136030 2023-09-30T01:56:11.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.579+0000 7f25596a2700 1 -- 172.21.15.55:0/4258029571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2554064440 con 0x7f2554136030 2023-09-30T01:56:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.583+0000 7f253bfff700 1 -- 172.21.15.55:0/4258029571 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f254c003030 con 0x7f2554136030 2023-09-30T01:56:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.583+0000 7f253bfff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.587+0000 7f253bfff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.587+0000 7f253bfff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.587+0000 7f253bfff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.587+0000 7f253bfff700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f254008e8b0 0x7f2540090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.587+0000 7f2553fff700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f254008e8b0 0x7f2540090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.587+0000 7f253bfff700 1 -- 172.21.15.55:0/4258029571 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f254c0b4d60 con 0x7f2554136030 2023-09-30T01:56:11.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.587+0000 7f2553fff700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f254008e8b0 0x7f2540090d60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2548003080 tx=0x7f2548017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:11.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.591+0000 7f253bfff700 1 -- 172.21.15.55:0/4258029571 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f254c0892b0 con 0x7f2554136030 2023-09-30T01:56:11.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.787+0000 7f25596a2700 1 -- 172.21.15.55:0/4258029571 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f255406b250 con 0x7f2554136030 2023-09-30T01:56:11.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.787+0000 7f253bfff700 1 -- 172.21.15.55:0/4258029571 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f254c088e40 con 0x7f2554136030 2023-09-30T01:56:11.794 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:11.795 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:11.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.791+0000 7f25596a2700 10 mgrc shutdown 2023-09-30T01:56:11.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.791+0000 7f25596a2700 1 -- 172.21.15.55:0/4258029571 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f254008e8b0 msgr2=0x7f2540090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.791+0000 7f25596a2700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f254008e8b0 0x7f2540090d60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f2548003080 tx=0x7f2548017000 comp rx=0 tx=0).stop 2023-09-30T01:56:11.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.791+0000 7f25596a2700 1 -- 172.21.15.55:0/4258029571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2554136030 msgr2=0x7f255406cf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:11.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.791+0000 7f25596a2700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2554136030 0x7f255406cf00 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f254c00c790 tx=0x7f254c0015f0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.791+0000 7f25596a2700 1 -- 172.21.15.55:0/4258029571 shutdown_connections 2023-09-30T01:56:11.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.791+0000 7f25596a2700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2554136030 0x7f255406cf00 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.791+0000 7f25596a2700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f25540a9130 0x7f2554131750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.791+0000 7f25596a2700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f254008e8b0 0x7f2540090d60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.791+0000 7f25596a2700 1 --2- 172.21.15.55:0/4258029571 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f25540a3d70 0x7f25540a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:11.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.791+0000 7f25596a2700 1 -- 172.21.15.55:0/4258029571 >> 172.21.15.55:0/4258029571 conn(0x7f25540b6940 msgr2=0x7f255406ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:11.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.791+0000 7f25596a2700 1 -- 172.21.15.55:0/4258029571 shutdown_connections 2023-09-30T01:56:11.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:11.791+0000 7f25596a2700 1 -- 172.21.15.55:0/4258029571 wait complete. 2023-09-30T01:56:13.773 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:56:13.775 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:56:14.812 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:14.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.923+0000 7f81b7492700 1 Processor -- start 2023-09-30T01:56:14.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.923+0000 7f81b7492700 1 -- start start 2023-09-30T01:56:14.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.923+0000 7f81b7492700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b00a4d60 0x7f81b00aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.923+0000 7f81b7492700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b00af120 con 0x7f81b00a4990 2023-09-30T01:56:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.923+0000 7f81b7492700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81b00af5b0 con 0x7f81b013a750 2023-09-30T01:56:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.923+0000 7f81b7492700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b009fb10 con 0x7f81b00a4d60 2023-09-30T01:56:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.923+0000 7f81b5c8f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b00a4d60 0x7f81b00aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.923+0000 7f81b6490700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f81b00a4990 0x7f81b00a1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57798/0 (socket says 172.21.15.55:57798) 2023-09-30T01:56:14.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.923+0000 7f81b6490700 1 -- 172.21.15.55:0/187439486 learned_addr learned my addr 172.21.15.55:0/187439486 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:14.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.923+0000 7f81b5c8f700 1 -- 172.21.15.55:0/187439486 >> v1:172.21.15.133:6789/0 conn(0x7f81b013a750 legacy=0x7f81b014ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:14.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.923+0000 7f81b5c8f700 1 -- 172.21.15.55:0/187439486 >> v1:172.21.15.55:6789/0 conn(0x7f81b00a4990 legacy=0x7f81b00a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:14.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.923+0000 7f81b5c8f700 1 -- 172.21.15.55:0/187439486 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81b009fdd0 con 0x7f81b00a4d60 2023-09-30T01:56:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.923+0000 7f81b5c8f700 1 --2- 172.21.15.55:0/187439486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b00a4d60 0x7f81b00aeb90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009910 tx=0x7f81ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b69aca9dfe70342b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.923+0000 7f81b548e700 1 -- 172.21.15.55:0/187439486 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00b820 con 0x7f81b00a4d60 2023-09-30T01:56:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.927+0000 7f81b548e700 1 -- 172.21.15.55:0/187439486 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81ac00b980 con 0x7f81b00a4d60 2023-09-30T01:56:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.927+0000 7f81b548e700 1 -- 172.21.15.55:0/187439486 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81ac00bd20 con 0x7f81b00a4d60 2023-09-30T01:56:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.927+0000 7f81b7492700 1 -- 172.21.15.55:0/187439486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b00a4d60 msgr2=0x7f81b00aeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.927+0000 7f81b7492700 1 --2- 172.21.15.55:0/187439486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b00a4d60 0x7f81b00aeb90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f81ac009910 tx=0x7f81ac0091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.927+0000 7f81b7492700 1 -- 172.21.15.55:0/187439486 shutdown_connections 2023-09-30T01:56:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.927+0000 7f81b7492700 1 --2- 172.21.15.55:0/187439486 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b00a4d60 0x7f81b00aeb90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.927+0000 7f81b7492700 1 -- 172.21.15.55:0/187439486 >> 172.21.15.55:0/187439486 conn(0x7f81b00b23d0 msgr2=0x7f81b00b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.927+0000 7f81b7492700 1 -- 172.21.15.55:0/187439486 shutdown_connections 2023-09-30T01:56:14.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.927+0000 7f81b7492700 1 -- 172.21.15.55:0/187439486 wait complete. 2023-09-30T01:56:14.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.927+0000 7f81b7492700 1 Processor -- start 2023-09-30T01:56:14.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.927+0000 7f81b7492700 1 -- start start 2023-09-30T01:56:14.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b7492700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b00a4990 0x7f81b0153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:14.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b7492700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b00a4d60 0x7f81b0096e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:14.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b7492700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81b013a750 0x7f81b0098300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:14.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b6490700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b00a4990 0x7f81b0153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:14.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b7492700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b0138cb0 con 0x7f81b00a4d60 2023-09-30T01:56:14.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b7492700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81b00632b0 con 0x7f81b013a750 2023-09-30T01:56:14.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b7492700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81b01547a0 con 0x7f81b00a4990 2023-09-30T01:56:14.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b6490700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b00a4990 0x7f81b0153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:57206/0 (socket says 172.21.15.55:57206) 2023-09-30T01:56:14.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b6490700 1 -- 172.21.15.55:0/3125654076 learned_addr learned my addr 172.21.15.55:0/3125654076 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:14.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b5c8f700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b00a4d60 0x7f81b0096e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:14.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b6c91700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81b013a750 0x7f81b0098300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:14.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b6490700 1 -- 172.21.15.55:0/3125654076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81b013a750 msgr2=0x7f81b0098300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:14.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b6490700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81b013a750 0x7f81b0098300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:14.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b6490700 1 -- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b00a4d60 msgr2=0x7f81b0096e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:14.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b6490700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b00a4d60 0x7f81b0096e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:14.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b6490700 1 -- 172.21.15.55:0/3125654076 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81ac009420 con 0x7f81b00a4990 2023-09-30T01:56:14.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b6c91700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81b013a750 0x7f81b0098300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T01:56:14.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b5c8f700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b00a4d60 0x7f81b0096e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:14.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b6490700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b00a4990 0x7f81b0153ea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f81a000c5c0 tx=0x7f81a0007f90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:14.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81a67fc700 1 -- 172.21.15.55:0/3125654076 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0005b30 con 0x7f81b00a4990 2023-09-30T01:56:14.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81a67fc700 1 -- 172.21.15.55:0/3125654076 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81a0005cb0 con 0x7f81b00a4990 2023-09-30T01:56:14.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b7492700 1 -- 172.21.15.55:0/3125654076 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81b0154a40 con 0x7f81b00a4990 2023-09-30T01:56:14.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81a67fc700 1 -- 172.21.15.55:0/3125654076 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81a0007320 con 0x7f81b00a4990 2023-09-30T01:56:14.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.931+0000 7f81b7492700 1 -- 172.21.15.55:0/3125654076 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81b01386f0 con 0x7f81b00a4990 2023-09-30T01:56:14.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.935+0000 7f81b7492700 1 -- 172.21.15.55:0/3125654076 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81b0064440 con 0x7f81b00a4990 2023-09-30T01:56:14.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.935+0000 7f81a67fc700 1 -- 172.21.15.55:0/3125654076 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f81a001b3b0 con 0x7f81b00a4990 2023-09-30T01:56:14.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.935+0000 7f81a67fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:14.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.935+0000 7f81a67fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:14.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.935+0000 7f81a67fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:14.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.935+0000 7f81a67fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:14.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.935+0000 7f81a67fc700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f819408e830 0x7f8194090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:14.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.935+0000 7f81b5c8f700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f819408e830 0x7f8194090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:14.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.935+0000 7f81a67fc700 1 -- 172.21.15.55:0/3125654076 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f81a00b3c70 con 0x7f81b00a4990 2023-09-30T01:56:14.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.939+0000 7f81b5c8f700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f819408e830 0x7f8194090ce0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81b00a5130 tx=0x7f81ac016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:14.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:14.943+0000 7f81a67fc700 1 -- 172.21.15.55:0/3125654076 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f81a0084690 con 0x7f81b00a4990 2023-09-30T01:56:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.139+0000 7f81b7492700 1 -- 172.21.15.55:0/3125654076 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f81b00a0090 con 0x7f81b00a4990 2023-09-30T01:56:15.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.139+0000 7f81a67fc700 1 -- 172.21.15.55:0/3125654076 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f81a0017080 con 0x7f81b00a4990 2023-09-30T01:56:15.144 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:15.144 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:15.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.143+0000 7f81b7492700 10 mgrc shutdown 2023-09-30T01:56:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.143+0000 7f81b7492700 1 -- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f819408e830 msgr2=0x7f8194090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.143+0000 7f81b7492700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f819408e830 0x7f8194090ce0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f81b00a5130 tx=0x7f81ac016000 comp rx=0 tx=0).stop 2023-09-30T01:56:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.143+0000 7f81b7492700 1 -- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b00a4990 msgr2=0x7f81b0153ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.143+0000 7f81b7492700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b00a4990 0x7f81b0153ea0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f81a000c5c0 tx=0x7f81a0007f90 comp rx=0 tx=0).stop 2023-09-30T01:56:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.143+0000 7f81b7492700 1 -- 172.21.15.55:0/3125654076 shutdown_connections 2023-09-30T01:56:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.143+0000 7f81b7492700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f81b013a750 0x7f81b0098300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.143+0000 7f81b7492700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f81b00a4d60 0x7f81b0096e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.143+0000 7f81b7492700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f819408e830 0x7f8194090ce0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.143+0000 7f81b7492700 1 --2- 172.21.15.55:0/3125654076 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f81b00a4990 0x7f81b0153ea0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.143+0000 7f81b7492700 1 -- 172.21.15.55:0/3125654076 >> 172.21.15.55:0/3125654076 conn(0x7f81b00b23d0 msgr2=0x7f81b00b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:15.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.143+0000 7f81b7492700 1 -- 172.21.15.55:0/3125654076 shutdown_connections 2023-09-30T01:56:15.148 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:15.143+0000 7f81b7492700 1 -- 172.21.15.55:0/3125654076 wait complete. 2023-09-30T01:56:18.159 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:18.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.267+0000 7f142d1f4700 1 Processor -- start 2023-09-30T01:56:18.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.267+0000 7f142d1f4700 1 -- start start 2023-09-30T01:56:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142d1f4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f142813da10 0x7f14281497a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142d1f4700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f142806e190 con 0x7f142813d610 2023-09-30T01:56:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142d1f4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14280b1a00 con 0x7f14280b1630 2023-09-30T01:56:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142d1f4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14281417f0 con 0x7f142813da10 2023-09-30T01:56:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f14277fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f142813d610 0x7f14280a4f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57800/0 (socket says 172.21.15.55:57800) 2023-09-30T01:56:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f14277fe700 1 -- 172.21.15.55:0/1985871907 learned_addr learned my addr 172.21.15.55:0/1985871907 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:18.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142c9f3700 1 --2- 172.21.15.55:0/1985871907 >> v2:172.21.15.133:3300/0 conn(0x7f142813da10 0x7f14281497a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:18.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f1426ffd700 1 -- 172.21.15.55:0/1985871907 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901839636 0 0) 0x7f142806e190 con 0x7f142813d610 2023-09-30T01:56:18.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f1426ffd700 1 -- 172.21.15.55:0/1985871907 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1410003570 con 0x7f142813d610 2023-09-30T01:56:18.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142c9f3700 1 -- 172.21.15.55:0/1985871907 >> v1:172.21.15.133:6789/0 conn(0x7f14280b1630 legacy=0x7f14280a67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142c9f3700 1 -- 172.21.15.55:0/1985871907 >> v1:172.21.15.55:6789/0 conn(0x7f142813d610 legacy=0x7f14280a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142c9f3700 1 -- 172.21.15.55:0/1985871907 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1428141ab0 con 0x7f142813da10 2023-09-30T01:56:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142c9f3700 1 --2- 172.21.15.55:0/1985871907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f142813da10 0x7f14281497a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1420009e60 tx=0x7f1420009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1c81200850edd51 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f1426ffd700 1 -- 172.21.15.55:0/1985871907 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142000e070 con 0x7f142813da10 2023-09-30T01:56:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f1426ffd700 1 -- 172.21.15.55:0/1985871907 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142000bb60 con 0x7f142813da10 2023-09-30T01:56:18.276 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f1426ffd700 1 -- 172.21.15.55:0/1985871907 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420012430 con 0x7f142813da10 2023-09-30T01:56:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142d1f4700 1 -- 172.21.15.55:0/1985871907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f142813da10 msgr2=0x7f14281497a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142d1f4700 1 --2- 172.21.15.55:0/1985871907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f142813da10 0x7f14281497a0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f1420009e60 tx=0x7f1420009780 comp rx=0 tx=0).stop 2023-09-30T01:56:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142d1f4700 1 -- 172.21.15.55:0/1985871907 shutdown_connections 2023-09-30T01:56:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142d1f4700 1 --2- 172.21.15.55:0/1985871907 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f142813da10 0x7f14281497a0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142d1f4700 1 -- 172.21.15.55:0/1985871907 >> 172.21.15.55:0/1985871907 conn(0x7f1428068770 msgr2=0x7f1428068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142d1f4700 1 -- 172.21.15.55:0/1985871907 shutdown_connections 2023-09-30T01:56:18.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.271+0000 7f142d1f4700 1 -- 172.21.15.55:0/1985871907 wait complete. 2023-09-30T01:56:18.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142d1f4700 1 Processor -- start 2023-09-30T01:56:18.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142d1f4700 1 -- start start 2023-09-30T01:56:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142d1f4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14280b1630 0x7f14280ac3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142d1f4700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f142813d610 0x7f14280ad4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142d1f4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f142813da10 0x7f14280aab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142d1f4700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142813b620 con 0x7f142813da10 2023-09-30T01:56:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142d1f4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14280ab570 con 0x7f14280b1630 2023-09-30T01:56:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142d1f4700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14280ab830 con 0x7f142813d610 2023-09-30T01:56:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142c9f3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f142813da10 0x7f14280aab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f14277fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f142813d610 0x7f14280ad4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142c9f3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f142813da10 0x7f14280aab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38580/0 (socket says 172.21.15.55:38580) 2023-09-30T01:56:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142c9f3700 1 -- 172.21.15.55:0/700835930 learned_addr learned my addr 172.21.15.55:0/700835930 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:18.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f1427fff700 1 --2- 172.21.15.55:0/700835930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14280b1630 0x7f14280ac3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142c9f3700 1 -- 172.21.15.55:0/700835930 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f142813d610 msgr2=0x7f14280ad4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142c9f3700 1 --2- 172.21.15.55:0/700835930 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f142813d610 0x7f14280ad4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142c9f3700 1 -- 172.21.15.55:0/700835930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14280b1630 msgr2=0x7f14280ac3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142c9f3700 1 --2- 172.21.15.55:0/700835930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14280b1630 0x7f14280ac3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142c9f3700 1 -- 172.21.15.55:0/700835930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1420009a20 con 0x7f142813da10 2023-09-30T01:56:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142c9f3700 1 --2- 172.21.15.55:0/700835930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f142813da10 0x7f14280aab80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1428063af0 tx=0x7f1420019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f140ffff700 1 -- 172.21.15.55:0/700835930 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1420027470 con 0x7f142813da10 2023-09-30T01:56:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f140ffff700 1 -- 172.21.15.55:0/700835930 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14200275f0 con 0x7f142813da10 2023-09-30T01:56:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142d1f4700 1 -- 172.21.15.55:0/700835930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14280ade00 con 0x7f142813da10 2023-09-30T01:56:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f140ffff700 1 -- 172.21.15.55:0/700835930 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14200279b0 con 0x7f142813da10 2023-09-30T01:56:18.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.275+0000 7f142d1f4700 1 -- 172.21.15.55:0/700835930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14280aa050 con 0x7f142813da10 2023-09-30T01:56:18.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.279+0000 7f142d1f4700 1 -- 172.21.15.55:0/700835930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142813e630 con 0x7f142813da10 2023-09-30T01:56:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.279+0000 7f140ffff700 1 -- 172.21.15.55:0/700835930 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f1420024070 con 0x7f142813da10 2023-09-30T01:56:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.279+0000 7f140ffff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.279+0000 7f140ffff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.279+0000 7f140ffff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.279+0000 7f140ffff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.279+0000 7f140ffff700 1 --2- 172.21.15.55:0/700835930 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f141408e830 0x7f1414090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.279+0000 7f140ffff700 1 -- 172.21.15.55:0/700835930 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f14200b7250 con 0x7f142813da10 2023-09-30T01:56:18.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.279+0000 7f1427fff700 1 --2- 172.21.15.55:0/700835930 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f141408e830 0x7f1414090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:18.286 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.283+0000 7f1427fff700 1 --2- 172.21.15.55:0/700835930 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f141408e830 0x7f1414090ce0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f141c003a80 tx=0x7f141c007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:18.292 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.287+0000 7f140ffff700 1 -- 172.21.15.55:0/700835930 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f142813e630 con 0x7f142813da10 2023-09-30T01:56:18.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.479+0000 7f142d1f4700 1 -- 172.21.15.55:0/700835930 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f142813e630 con 0x7f142813da10 2023-09-30T01:56:18.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.479+0000 7f140ffff700 1 -- 172.21.15.55:0/700835930 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f142813e630 con 0x7f142813da10 2023-09-30T01:56:18.485 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:18.485 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:18.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.483+0000 7f142d1f4700 10 mgrc shutdown 2023-09-30T01:56:18.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.483+0000 7f142d1f4700 1 -- 172.21.15.55:0/700835930 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f141408e830 msgr2=0x7f1414090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:18.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.483+0000 7f142d1f4700 1 --2- 172.21.15.55:0/700835930 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f141408e830 0x7f1414090ce0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f141c003a80 tx=0x7f141c007ec0 comp rx=0 tx=0).stop 2023-09-30T01:56:18.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.483+0000 7f142d1f4700 1 -- 172.21.15.55:0/700835930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f142813da10 msgr2=0x7f14280aab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:18.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.483+0000 7f142d1f4700 1 --2- 172.21.15.55:0/700835930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f142813da10 0x7f14280aab80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f1428063af0 tx=0x7f1420019000 comp rx=0 tx=0).stop 2023-09-30T01:56:18.489 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.483+0000 7f142d1f4700 1 -- 172.21.15.55:0/700835930 shutdown_connections 2023-09-30T01:56:18.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.483+0000 7f142d1f4700 1 --2- 172.21.15.55:0/700835930 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f142813da10 0x7f14280aab80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:18.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.483+0000 7f142d1f4700 1 --2- 172.21.15.55:0/700835930 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f141408e830 0x7f1414090ce0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:18.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.483+0000 7f142d1f4700 1 --2- 172.21.15.55:0/700835930 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f142813d610 0x7f14280ad4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:18.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.483+0000 7f142d1f4700 1 --2- 172.21.15.55:0/700835930 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f14280b1630 0x7f14280ac3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:18.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.483+0000 7f142d1f4700 1 -- 172.21.15.55:0/700835930 >> 172.21.15.55:0/700835930 conn(0x7f1428068770 msgr2=0x7f14281401a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:18.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.483+0000 7f142d1f4700 1 -- 172.21.15.55:0/700835930 shutdown_connections 2023-09-30T01:56:18.490 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:18.483+0000 7f142d1f4700 1 -- 172.21.15.55:0/700835930 wait complete. 2023-09-30T01:56:21.505 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:21.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f22b52700 1 Processor -- start 2023-09-30T01:56:21.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f22b52700 1 -- start start 2023-09-30T01:56:21.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f22b52700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f1c0a4bc0 0x7f7f1c06af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:21.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f22b52700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f1c06c360 0x7f7f1c06c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:21.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f22b52700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f1c0a1880 con 0x7f7f1c13d060 2023-09-30T01:56:21.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f22b52700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f1c0a4f90 con 0x7f7f1c0a4bc0 2023-09-30T01:56:21.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f22b52700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c0a1ab0 con 0x7f7f1c06c360 2023-09-30T01:56:21.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f2134f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f1c06c360 0x7f7f1c06c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:21.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f2134f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f1c06c360 0x7f7f1c06c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:57222/0 (socket says 172.21.15.55:57222) 2023-09-30T01:56:21.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f21b50700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7f1c0a4bc0 0x7f7f1c06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:21.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f2134f700 1 -- 172.21.15.55:0/702491032 learned_addr learned my addr 172.21.15.55:0/702491032 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f22351700 1 --1- 172.21.15.55:0/702491032 >> v1:172.21.15.55:6789/0 conn(0x7f7f1c13d060 0x7f7f1c13d4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57814/0 (socket says 172.21.15.55:57814) 2023-09-30T01:56:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f2134f700 1 -- 172.21.15.55:0/702491032 >> v2:172.21.15.55:3300/0 conn(0x7f7f1c0a4bc0 msgr2=0x7f7f1c06af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f2134f700 1 --2- 172.21.15.55:0/702491032 >> v2:172.21.15.55:3300/0 conn(0x7f7f1c0a4bc0 0x7f7f1c06af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f2134f700 1 -- 172.21.15.55:0/702491032 >> v1:172.21.15.55:6789/0 conn(0x7f7f1c13d060 legacy=0x7f7f1c13d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f2134f700 1 -- 172.21.15.55:0/702491032 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f1c0a1d70 con 0x7f7f1c06c360 2023-09-30T01:56:21.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.611+0000 7f7f2134f700 1 --2- 172.21.15.55:0/702491032 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f1c06c360 0x7f7f1c06c730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0a1f60 tx=0x7f7f0c00b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5f53ae2c605286be server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:21.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f20b4e700 1 -- 172.21.15.55:0/702491032 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c00dba0 con 0x7f7f1c06c360 2023-09-30T01:56:21.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f20b4e700 1 -- 172.21.15.55:0/702491032 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c00dd00 con 0x7f7f1c06c360 2023-09-30T01:56:21.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f20b4e700 1 -- 172.21.15.55:0/702491032 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c0106a0 con 0x7f7f1c06c360 2023-09-30T01:56:21.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 -- 172.21.15.55:0/702491032 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f1c06c360 msgr2=0x7f7f1c06c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:21.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 --2- 172.21.15.55:0/702491032 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f1c06c360 0x7f7f1c06c730 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f7f1c0a1f60 tx=0x7f7f0c00b4f0 comp rx=0 tx=0).stop 2023-09-30T01:56:21.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 -- 172.21.15.55:0/702491032 shutdown_connections 2023-09-30T01:56:21.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 --2- 172.21.15.55:0/702491032 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f1c06c360 0x7f7f1c06c730 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:21.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 --2- 172.21.15.55:0/702491032 >> v2:172.21.15.55:3300/0 conn(0x7f7f1c0a4bc0 0x7f7f1c06af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:21.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 -- 172.21.15.55:0/702491032 >> 172.21.15.55:0/702491032 conn(0x7f7f1c0b23d0 msgr2=0x7f7f1c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:21.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 -- 172.21.15.55:0/702491032 shutdown_connections 2023-09-30T01:56:21.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 -- 172.21.15.55:0/702491032 wait complete. 2023-09-30T01:56:21.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 Processor -- start 2023-09-30T01:56:21.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 -- start start 2023-09-30T01:56:21.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f1c06c360 0x7f7f1c09a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:21.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f1c0a4bc0 0x7f7f1c0990b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f1c13d060 0x7f7f1c141390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c1418d0 con 0x7f7f1c0a4bc0 2023-09-30T01:56:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c09a400 con 0x7f7f1c06c360 2023-09-30T01:56:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22b52700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f1c099a50 con 0x7f7f1c13d060 2023-09-30T01:56:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f2134f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f1c0a4bc0 0x7f7f1c0990b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f2134f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f1c0a4bc0 0x7f7f1c0990b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:38592/0 (socket says 172.21.15.55:38592) 2023-09-30T01:56:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f2134f700 1 -- 172.21.15.55:0/1611927445 learned_addr learned my addr 172.21.15.55:0/1611927445 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f22351700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f1c13d060 0x7f7f1c141390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f21b50700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f1c06c360 0x7f7f1c09a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f2134f700 1 -- 172.21.15.55:0/1611927445 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f1c13d060 msgr2=0x7f7f1c141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:21.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f2134f700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f1c13d060 0x7f7f1c141390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f2134f700 1 -- 172.21.15.55:0/1611927445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f1c06c360 msgr2=0x7f7f1c09a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f2134f700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f1c06c360 0x7f7f1c09a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f2134f700 1 -- 172.21.15.55:0/1611927445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f0c00b790 con 0x7f7f1c0a4bc0 2023-09-30T01:56:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f21b50700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f1c06c360 0x7f7f1c09a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:56:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.615+0000 7f7f2134f700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f1c0a4bc0 0x7f7f1c0990b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c006fd0 tx=0x7f7f0c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.619+0000 7f7f19ffb700 1 -- 172.21.15.55:0/1611927445 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c018700 con 0x7f7f1c0a4bc0 2023-09-30T01:56:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.619+0000 7f7f19ffb700 1 -- 172.21.15.55:0/1611927445 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0c018860 con 0x7f7f1c0a4bc0 2023-09-30T01:56:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.619+0000 7f7f22b52700 1 -- 172.21.15.55:0/1611927445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f1c141ae0 con 0x7f7f1c0a4bc0 2023-09-30T01:56:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.619+0000 7f7f19ffb700 1 -- 172.21.15.55:0/1611927445 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0c018c20 con 0x7f7f1c0a4bc0 2023-09-30T01:56:21.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.619+0000 7f7f22b52700 1 -- 172.21.15.55:0/1611927445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f1c0a0f40 con 0x7f7f1c0a4bc0 2023-09-30T01:56:21.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.619+0000 7f7f22b52700 1 -- 172.21.15.55:0/1611927445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f1c064440 con 0x7f7f1c0a4bc0 2023-09-30T01:56:21.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.623+0000 7f7f19ffb700 1 -- 172.21.15.55:0/1611927445 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f7f0c0233d0 con 0x7f7f1c0a4bc0 2023-09-30T01:56:21.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.623+0000 7f7f19ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:21.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.623+0000 7f7f19ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:21.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.623+0000 7f7f19ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:21.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.623+0000 7f7f19ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:21.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.623+0000 7f7f19ffb700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7f0808e8b0 0x7f7f08090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:21.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.623+0000 7f7f19ffb700 1 -- 172.21.15.55:0/1611927445 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f7f0c014070 con 0x7f7f1c0a4bc0 2023-09-30T01:56:21.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.623+0000 7f7f21b50700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7f0808e8b0 0x7f7f08090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:21.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.623+0000 7f7f21b50700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7f0808e8b0 0x7f7f08090d60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f140076c0 tx=0x7f7f1400b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:21.634 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.631+0000 7f7f19ffb700 1 -- 172.21.15.55:0/1611927445 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7f0c088c90 con 0x7f7f1c0a4bc0 2023-09-30T01:56:21.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.831+0000 7f7f22b52700 1 -- 172.21.15.55:0/1611927445 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7f1c09a540 con 0x7f7f1c0a4bc0 2023-09-30T01:56:21.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.831+0000 7f7f19ffb700 1 -- 172.21.15.55:0/1611927445 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f7f0c029100 con 0x7f7f1c0a4bc0 2023-09-30T01:56:21.836 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:21.836 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:21.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.835+0000 7f7f22b52700 10 mgrc shutdown 2023-09-30T01:56:21.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.835+0000 7f7f22b52700 1 -- 172.21.15.55:0/1611927445 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7f0808e8b0 msgr2=0x7f7f08090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:21.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.835+0000 7f7f22b52700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7f0808e8b0 0x7f7f08090d60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f7f140076c0 tx=0x7f7f1400b040 comp rx=0 tx=0).stop 2023-09-30T01:56:21.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.835+0000 7f7f22b52700 1 -- 172.21.15.55:0/1611927445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f1c0a4bc0 msgr2=0x7f7f1c0990b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:21.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.835+0000 7f7f22b52700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f1c0a4bc0 0x7f7f1c0990b0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c006fd0 tx=0x7f7f0c01a000 comp rx=0 tx=0).stop 2023-09-30T01:56:21.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.835+0000 7f7f22b52700 1 -- 172.21.15.55:0/1611927445 shutdown_connections 2023-09-30T01:56:21.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.835+0000 7f7f22b52700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7f0808e8b0 0x7f7f08090d60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:21.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.835+0000 7f7f22b52700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7f1c13d060 0x7f7f1c141390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:21.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.835+0000 7f7f22b52700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7f1c0a4bc0 0x7f7f1c0990b0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:21.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.835+0000 7f7f22b52700 1 --2- 172.21.15.55:0/1611927445 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7f1c06c360 0x7f7f1c09a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:21.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.835+0000 7f7f22b52700 1 -- 172.21.15.55:0/1611927445 >> 172.21.15.55:0/1611927445 conn(0x7f7f1c0b23d0 msgr2=0x7f7f1c13a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:21.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.835+0000 7f7f22b52700 1 -- 172.21.15.55:0/1611927445 shutdown_connections 2023-09-30T01:56:21.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:21.835+0000 7f7f22b52700 1 -- 172.21.15.55:0/1611927445 wait complete. 2023-09-30T01:56:24.852 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:24.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 Processor -- start 2023-09-30T01:56:24.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 -- start start 2023-09-30T01:56:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8240677c0 0x7fa8240a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8240a65f0 0x7fa82413f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa824067b90 con 0x7fa82413fd80 2023-09-30T01:56:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8240a5460 con 0x7fa8240677c0 2023-09-30T01:56:24.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8240a5720 con 0x7fa8240a65f0 2023-09-30T01:56:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa828adb700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8240a65f0 0x7fa82413f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa828adb700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8240a65f0 0x7fa82413f840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55592/0 (socket says 172.21.15.55:55592) 2023-09-30T01:56:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa828adb700 1 -- 172.21.15.55:0/1389084558 learned_addr learned my addr 172.21.15.55:0/1389084558 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa8292dc700 1 --2- 172.21.15.55:0/1389084558 >> v2:172.21.15.133:3300/0 conn(0x7fa8240677c0 0x7fa8240a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa828adb700 1 -- 172.21.15.55:0/1389084558 >> v2:172.21.15.133:3300/0 conn(0x7fa8240677c0 msgr2=0x7fa8240a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa828adb700 1 --2- 172.21.15.55:0/1389084558 >> v2:172.21.15.133:3300/0 conn(0x7fa8240677c0 0x7fa8240a93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa828adb700 1 -- 172.21.15.55:0/1389084558 >> v1:172.21.15.133:6789/0 conn(0x7fa82413fd80 legacy=0x7fa8240a6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa828adb700 1 -- 172.21.15.55:0/1389084558 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8240a9910 con 0x7fa8240a65f0 2023-09-30T01:56:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa8292dc700 1 --2- 172.21.15.55:0/1389084558 >> v2:172.21.15.133:3300/0 conn(0x7fa8240677c0 0x7fa8240a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T01:56:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa828adb700 1 --2- 172.21.15.55:0/1389084558 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8240a65f0 0x7fa82413f840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa8200099b0 tx=0x7fa820009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5c798fa26fa511ed server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:24.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa817fff700 1 -- 172.21.15.55:0/1389084558 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82000b860 con 0x7fa8240a65f0 2023-09-30T01:56:24.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa817fff700 1 -- 172.21.15.55:0/1389084558 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82000b9c0 con 0x7fa8240a65f0 2023-09-30T01:56:24.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa817fff700 1 -- 172.21.15.55:0/1389084558 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82000bd60 con 0x7fa8240a65f0 2023-09-30T01:56:24.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 -- 172.21.15.55:0/1389084558 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8240a65f0 msgr2=0x7fa82413f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 --2- 172.21.15.55:0/1389084558 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8240a65f0 0x7fa82413f840 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fa8200099b0 tx=0x7fa820009250 comp rx=0 tx=0).stop 2023-09-30T01:56:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 -- 172.21.15.55:0/1389084558 shutdown_connections 2023-09-30T01:56:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 --2- 172.21.15.55:0/1389084558 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8240a65f0 0x7fa82413f840 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 --2- 172.21.15.55:0/1389084558 >> v2:172.21.15.133:3300/0 conn(0x7fa8240677c0 0x7fa8240a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 -- 172.21.15.55:0/1389084558 >> 172.21.15.55:0/1389084558 conn(0x7fa824068820 msgr2=0x7fa824068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 -- 172.21.15.55:0/1389084558 shutdown_connections 2023-09-30T01:56:24.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.963+0000 7fa82a2de700 1 -- 172.21.15.55:0/1389084558 wait complete. 2023-09-30T01:56:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.967+0000 7fa82a2de700 1 Processor -- start 2023-09-30T01:56:24.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.967+0000 7fa82a2de700 1 -- start start 2023-09-30T01:56:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.967+0000 7fa82a2de700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8240677c0 0x7fa82409a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.967+0000 7fa82a2de700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8240a65f0 0x7fa8241437c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.967+0000 7fa82a2de700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa82413fd80 0x7fa82406cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.967+0000 7fa82a2de700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa82406e100 con 0x7fa8240a65f0 2023-09-30T01:56:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.967+0000 7fa82a2de700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa824150370 con 0x7fa82413fd80 2023-09-30T01:56:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.967+0000 7fa82a2de700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa824150610 con 0x7fa8240677c0 2023-09-30T01:56:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.967+0000 7fa8292dc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8240677c0 0x7fa82409a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:24.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.967+0000 7fa828adb700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8240a65f0 0x7fa8241437c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:24.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.967+0000 7fa8292dc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8240677c0 0x7fa82409a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55602/0 (socket says 172.21.15.55:55602) 2023-09-30T01:56:24.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.967+0000 7fa8292dc700 1 -- 172.21.15.55:0/1227480311 learned_addr learned my addr 172.21.15.55:0/1227480311 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:24.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.967+0000 7fa829add700 1 --2- 172.21.15.55:0/1227480311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa82413fd80 0x7fa82406cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:24.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa8292dc700 1 -- 172.21.15.55:0/1227480311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa82413fd80 msgr2=0x7fa82406cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:24.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa8292dc700 1 --2- 172.21.15.55:0/1227480311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa82413fd80 0x7fa82406cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:24.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa8292dc700 1 -- 172.21.15.55:0/1227480311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8240a65f0 msgr2=0x7fa8241437c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:24.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa8292dc700 1 --2- 172.21.15.55:0/1227480311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8240a65f0 0x7fa8241437c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:24.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa8292dc700 1 -- 172.21.15.55:0/1227480311 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8200094f0 con 0x7fa8240677c0 2023-09-30T01:56:24.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa828adb700 1 --2- 172.21.15.55:0/1227480311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8240a65f0 0x7fa8241437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:24.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa8292dc700 1 --2- 172.21.15.55:0/1227480311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8240677c0 0x7fa82409a090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa81800c850 tx=0x7fa818008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:24.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa8157fa700 1 -- 172.21.15.55:0/1227480311 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818011600 con 0x7fa8240677c0 2023-09-30T01:56:24.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa8157fa700 1 -- 172.21.15.55:0/1227480311 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa818011760 con 0x7fa8240677c0 2023-09-30T01:56:24.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa82a2de700 1 -- 172.21.15.55:0/1227480311 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa824150fc0 con 0x7fa8240677c0 2023-09-30T01:56:24.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa8157fa700 1 -- 172.21.15.55:0/1227480311 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa818011b00 con 0x7fa8240677c0 2023-09-30T01:56:24.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa82a2de700 1 -- 172.21.15.55:0/1227480311 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa824143d00 con 0x7fa8240677c0 2023-09-30T01:56:24.976 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa82a2de700 1 -- 172.21.15.55:0/1227480311 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa824064440 con 0x7fa8240677c0 2023-09-30T01:56:24.977 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa8157fa700 1 -- 172.21.15.55:0/1227480311 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fa818018350 con 0x7fa8240677c0 2023-09-30T01:56:24.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.971+0000 7fa8157fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:24.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.975+0000 7fa8157fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:24.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.975+0000 7fa8157fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:24.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.975+0000 7fa8157fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:24.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.975+0000 7fa8157fa700 1 --2- 172.21.15.55:0/1227480311 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa80808e8b0 0x7fa808090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:24.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.975+0000 7fa828adb700 1 --2- 172.21.15.55:0/1227480311 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa80808e8b0 0x7fa808090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:24.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.975+0000 7fa8157fa700 1 -- 172.21.15.55:0/1227480311 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fa8180b4620 con 0x7fa8240677c0 2023-09-30T01:56:24.979 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.975+0000 7fa828adb700 1 --2- 172.21.15.55:0/1227480311 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa80808e8b0 0x7fa808090d60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8200099b0 tx=0x7fa820017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:24.985 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:24.979+0000 7fa8157fa700 1 -- 172.21.15.55:0/1227480311 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa818088b70 con 0x7fa8240677c0 2023-09-30T01:56:25.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.175+0000 7fa82a2de700 1 -- 172.21.15.55:0/1227480311 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa82406bd30 con 0x7fa8240677c0 2023-09-30T01:56:25.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.175+0000 7fa8157fa700 1 -- 172.21.15.55:0/1227480311 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa818088700 con 0x7fa8240677c0 2023-09-30T01:56:25.181 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:25.181 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.179+0000 7fa82a2de700 10 mgrc shutdown 2023-09-30T01:56:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.179+0000 7fa82a2de700 1 -- 172.21.15.55:0/1227480311 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa80808e8b0 msgr2=0x7fa808090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:25.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.179+0000 7fa82a2de700 1 --2- 172.21.15.55:0/1227480311 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa80808e8b0 0x7fa808090d60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8200099b0 tx=0x7fa820017000 comp rx=0 tx=0).stop 2023-09-30T01:56:25.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.179+0000 7fa82a2de700 1 -- 172.21.15.55:0/1227480311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8240677c0 msgr2=0x7fa82409a090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:25.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.179+0000 7fa82a2de700 1 --2- 172.21.15.55:0/1227480311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8240677c0 0x7fa82409a090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa81800c850 tx=0x7fa818008040 comp rx=0 tx=0).stop 2023-09-30T01:56:25.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.179+0000 7fa82a2de700 1 -- 172.21.15.55:0/1227480311 shutdown_connections 2023-09-30T01:56:25.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.179+0000 7fa82a2de700 1 --2- 172.21.15.55:0/1227480311 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa82413fd80 0x7fa82406cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:25.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.179+0000 7fa82a2de700 1 --2- 172.21.15.55:0/1227480311 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8240a65f0 0x7fa8241437c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:25.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.179+0000 7fa82a2de700 1 --2- 172.21.15.55:0/1227480311 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa80808e8b0 0x7fa808090d60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:25.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.179+0000 7fa82a2de700 1 --2- 172.21.15.55:0/1227480311 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8240677c0 0x7fa82409a090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:25.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.179+0000 7fa82a2de700 1 -- 172.21.15.55:0/1227480311 >> 172.21.15.55:0/1227480311 conn(0x7fa824068820 msgr2=0x7fa82413ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:25.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.179+0000 7fa82a2de700 1 -- 172.21.15.55:0/1227480311 shutdown_connections 2023-09-30T01:56:25.184 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:25.179+0000 7fa82a2de700 1 -- 172.21.15.55:0/1227480311 wait complete. 2023-09-30T01:56:28.196 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:28.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.307+0000 7f2535a74700 1 Processor -- start 2023-09-30T01:56:28.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.307+0000 7f2535a74700 1 -- start start 2023-09-30T01:56:28.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.307+0000 7f2535a74700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25300a14a0 0x7f253006bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:28.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.307+0000 7f2535a74700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f253006aac0 0x7f2530132000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:28.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.307+0000 7f2535a74700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f253009f370 con 0x7f253006bbd0 2023-09-30T01:56:28.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.307+0000 7f2535a74700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253009f5a0 con 0x7f25300a14a0 2023-09-30T01:56:28.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.307+0000 7f2535a74700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f253009f860 con 0x7f253006aac0 2023-09-30T01:56:28.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.307+0000 7f252ffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f25300a14a0 0x7f253006bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:28.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.307+0000 7f2534a72700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f253006bbd0 0x7f25300a1b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43586/0 (socket says 172.21.15.55:43586) 2023-09-30T01:56:28.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.307+0000 7f2534a72700 1 -- 172.21.15.55:0/3168439878 learned_addr learned my addr 172.21.15.55:0/3168439878 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:28.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.307+0000 7f2535273700 1 --2- 172.21.15.55:0/3168439878 >> v2:172.21.15.133:3300/0 conn(0x7f253006aac0 0x7f2530132000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:28.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f252ffff700 1 -- 172.21.15.55:0/3168439878 >> v2:172.21.15.133:3300/0 conn(0x7f253006aac0 msgr2=0x7f2530132000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:28.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f252ffff700 1 --2- 172.21.15.55:0/3168439878 >> v2:172.21.15.133:3300/0 conn(0x7f253006aac0 0x7f2530132000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:28.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f252ffff700 1 -- 172.21.15.55:0/3168439878 >> v1:172.21.15.55:6789/0 conn(0x7f253006bbd0 legacy=0x7f25300a1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:28.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f252ffff700 1 -- 172.21.15.55:0/3168439878 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25300a2270 con 0x7f25300a14a0 2023-09-30T01:56:28.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f252ffff700 1 --2- 172.21.15.55:0/3168439878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25300a14a0 0x7f253006bfa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f253006c830 tx=0x7f25200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcbf552b37e753ff server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:28.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f252f7fe700 1 -- 172.21.15.55:0/3168439878 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520011630 con 0x7f25300a14a0 2023-09-30T01:56:28.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f252f7fe700 1 -- 172.21.15.55:0/3168439878 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2520011790 con 0x7f25300a14a0 2023-09-30T01:56:28.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f252f7fe700 1 -- 172.21.15.55:0/3168439878 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2520011b30 con 0x7f25300a14a0 2023-09-30T01:56:28.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 -- 172.21.15.55:0/3168439878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25300a14a0 msgr2=0x7f253006bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:28.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 --2- 172.21.15.55:0/3168439878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25300a14a0 0x7f253006bfa0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f253006c830 tx=0x7f25200091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:28.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 -- 172.21.15.55:0/3168439878 shutdown_connections 2023-09-30T01:56:28.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 --2- 172.21.15.55:0/3168439878 >> v2:172.21.15.133:3300/0 conn(0x7f253006aac0 0x7f2530132000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:28.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 --2- 172.21.15.55:0/3168439878 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25300a14a0 0x7f253006bfa0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:28.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 -- 172.21.15.55:0/3168439878 >> 172.21.15.55:0/3168439878 conn(0x7f25300b23d0 msgr2=0x7f25300b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:28.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 -- 172.21.15.55:0/3168439878 shutdown_connections 2023-09-30T01:56:28.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 -- 172.21.15.55:0/3168439878 wait complete. 2023-09-30T01:56:28.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 Processor -- start 2023-09-30T01:56:28.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 -- start start 2023-09-30T01:56:28.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f253006aac0 0x7f253012d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:28.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f253006bbd0 0x7f25300a4f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:28.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25300a3a60 0x7f25300a3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:28.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300a4a90 con 0x7f25300a3a60 2023-09-30T01:56:28.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25300a4820 con 0x7f253006aac0 2023-09-30T01:56:28.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535a74700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f253012dc30 con 0x7f253006bbd0 2023-09-30T01:56:28.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f252ffff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f253006bbd0 0x7f25300a4f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:28.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f252ffff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f253006bbd0 0x7f25300a4f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55608/0 (socket says 172.21.15.55:55608) 2023-09-30T01:56:28.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f252ffff700 1 -- 172.21.15.55:0/629872557 learned_addr learned my addr 172.21.15.55:0/629872557 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2535273700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25300a3a60 0x7f25300a3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.311+0000 7f2534a72700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f253006aac0 0x7f253012d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.315+0000 7f2535273700 1 -- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f253006bbd0 msgr2=0x7f25300a4f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.315+0000 7f2535273700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f253006bbd0 0x7f25300a4f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.315+0000 7f2535273700 1 -- 172.21.15.55:0/629872557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f253006aac0 msgr2=0x7f253012d350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.315+0000 7f2535273700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f253006aac0 0x7f253012d350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.315+0000 7f2535273700 1 -- 172.21.15.55:0/629872557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2520009420 con 0x7f25300a3a60 2023-09-30T01:56:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.315+0000 7f252ffff700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f253006bbd0 0x7f25300a4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.315+0000 7f2535273700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25300a3a60 0x7f25300a3eb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2528009e20 tx=0x7f252800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.315+0000 7f252cff9700 1 -- 172.21.15.55:0/629872557 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252800caa0 con 0x7f25300a3a60 2023-09-30T01:56:28.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.315+0000 7f252cff9700 1 -- 172.21.15.55:0/629872557 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252800f040 con 0x7f25300a3a60 2023-09-30T01:56:28.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.315+0000 7f2535a74700 1 -- 172.21.15.55:0/629872557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f253012def0 con 0x7f25300a3a60 2023-09-30T01:56:28.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.315+0000 7f252cff9700 1 -- 172.21.15.55:0/629872557 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252800ce50 con 0x7f25300a3a60 2023-09-30T01:56:28.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.315+0000 7f2535a74700 1 -- 172.21.15.55:0/629872557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25301530d0 con 0x7f25300a3a60 2023-09-30T01:56:28.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.315+0000 7f2535a74700 1 -- 172.21.15.55:0/629872557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2530064440 con 0x7f25300a3a60 2023-09-30T01:56:28.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.319+0000 7f252cff9700 1 -- 172.21.15.55:0/629872557 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f2528014690 con 0x7f25300a3a60 2023-09-30T01:56:28.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.319+0000 7f252cff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:28.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.319+0000 7f252cff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:28.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.319+0000 7f252cff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:28.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.319+0000 7f252cff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:28.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.319+0000 7f252cff9700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f251c08e8b0 0x7f251c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:28.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.319+0000 7f252cff9700 1 -- 172.21.15.55:0/629872557 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f25280b52f0 con 0x7f25300a3a60 2023-09-30T01:56:28.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.319+0000 7f2534a72700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f251c08e8b0 0x7f251c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:28.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.319+0000 7f2534a72700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f251c08e8b0 0x7f251c090d60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2524007130 tx=0x7f2524007eb0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:28.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.327+0000 7f252cff9700 1 -- 172.21.15.55:0/629872557 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2528089840 con 0x7f25300a3a60 2023-09-30T01:56:28.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.519+0000 7f2535a74700 1 -- 172.21.15.55:0/629872557 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2530132540 con 0x7f25300a3a60 2023-09-30T01:56:28.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.519+0000 7f252cff9700 1 -- 172.21.15.55:0/629872557 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f2528018100 con 0x7f25300a3a60 2023-09-30T01:56:28.525 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:28.525 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:28.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.523+0000 7f2535a74700 10 mgrc shutdown 2023-09-30T01:56:28.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.523+0000 7f2535a74700 1 -- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f251c08e8b0 msgr2=0x7f251c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:28.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.523+0000 7f2535a74700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f251c08e8b0 0x7f251c090d60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2524007130 tx=0x7f2524007eb0 comp rx=0 tx=0).stop 2023-09-30T01:56:28.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.523+0000 7f2535a74700 1 -- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25300a3a60 msgr2=0x7f25300a3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:28.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.523+0000 7f2535a74700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25300a3a60 0x7f25300a3eb0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2528009e20 tx=0x7f252800b040 comp rx=0 tx=0).stop 2023-09-30T01:56:28.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.523+0000 7f2535a74700 1 -- 172.21.15.55:0/629872557 shutdown_connections 2023-09-30T01:56:28.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.523+0000 7f2535a74700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f25300a3a60 0x7f25300a3eb0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:28.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.523+0000 7f2535a74700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f251c08e8b0 0x7f251c090d60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:28.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.523+0000 7f2535a74700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f253006bbd0 0x7f25300a4f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:28.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.523+0000 7f2535a74700 1 --2- 172.21.15.55:0/629872557 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f253006aac0 0x7f253012d350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:28.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.523+0000 7f2535a74700 1 -- 172.21.15.55:0/629872557 >> 172.21.15.55:0/629872557 conn(0x7f25300b23d0 msgr2=0x7f25300677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:28.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.523+0000 7f2535a74700 1 -- 172.21.15.55:0/629872557 shutdown_connections 2023-09-30T01:56:28.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:28.523+0000 7f2535a74700 1 -- 172.21.15.55:0/629872557 wait complete. 2023-09-30T01:56:31.541 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:31.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.651+0000 7ff15c9ec700 1 Processor -- start 2023-09-30T01:56:31.656 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.651+0000 7ff15c9ec700 1 -- start start 2023-09-30T01:56:31.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.651+0000 7ff15c9ec700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1580a9130 0x7ff15806b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.651+0000 7ff15c9ec700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7ff1580a3d70 0x7ff1580a4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.651+0000 7ff15c9ec700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1580a38e0 con 0x7ff158136030 2023-09-30T01:56:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.651+0000 7ff15c9ec700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff15806bae0 con 0x7ff1580a9130 2023-09-30T01:56:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.651+0000 7ff15c9ec700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1580a69c0 con 0x7ff1580a3d70 2023-09-30T01:56:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.651+0000 7ff156d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1580a9130 0x7ff15806b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.651+0000 7ff156d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff1580a9130 0x7ff15806b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54736/0 (socket says 172.21.15.55:54736) 2023-09-30T01:56:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.651+0000 7ff156d9d700 1 -- 172.21.15.55:0/1532350108 learned_addr learned my addr 172.21.15.55:0/1532350108 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff15659c700 1 --2- 172.21.15.55:0/1532350108 >> v2:172.21.15.133:3300/0 conn(0x7ff1580a3d70 0x7ff1580a4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff156d9d700 1 -- 172.21.15.55:0/1532350108 >> v2:172.21.15.133:3300/0 conn(0x7ff1580a3d70 msgr2=0x7ff1580a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:31.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff156d9d700 1 --2- 172.21.15.55:0/1532350108 >> v2:172.21.15.133:3300/0 conn(0x7ff1580a3d70 0x7ff1580a4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:31.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff156d9d700 1 -- 172.21.15.55:0/1532350108 >> v1:172.21.15.133:6789/0 conn(0x7ff158136030 legacy=0x7ff158136430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:31.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff156d9d700 1 -- 172.21.15.55:0/1532350108 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1580a9500 con 0x7ff1580a9130 2023-09-30T01:56:31.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff15659c700 1 --2- 172.21.15.55:0/1532350108 >> v2:172.21.15.133:3300/0 conn(0x7ff1580a3d70 0x7ff1580a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:56:31.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff156d9d700 1 --2- 172.21.15.55:0/1532350108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580a9130 0x7ff15806b5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff158070a50 tx=0x7ff140009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e6a2239ba3afdc server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:31.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff155d9b700 1 -- 172.21.15.55:0/1532350108 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14000b860 con 0x7ff1580a9130 2023-09-30T01:56:31.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff155d9b700 1 -- 172.21.15.55:0/1532350108 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14000b9c0 con 0x7ff1580a9130 2023-09-30T01:56:31.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff155d9b700 1 -- 172.21.15.55:0/1532350108 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14000bd60 con 0x7ff1580a9130 2023-09-30T01:56:31.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1532350108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580a9130 msgr2=0x7ff15806b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:31.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff15c9ec700 1 --2- 172.21.15.55:0/1532350108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580a9130 0x7ff15806b5a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff158070a50 tx=0x7ff140009250 comp rx=0 tx=0).stop 2023-09-30T01:56:31.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1532350108 shutdown_connections 2023-09-30T01:56:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff15c9ec700 1 --2- 172.21.15.55:0/1532350108 >> v2:172.21.15.133:3300/0 conn(0x7ff1580a3d70 0x7ff1580a4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff15c9ec700 1 --2- 172.21.15.55:0/1532350108 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580a9130 0x7ff15806b5a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1532350108 >> 172.21.15.55:0/1532350108 conn(0x7ff1580b6940 msgr2=0x7ff1580b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1532350108 shutdown_connections 2023-09-30T01:56:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1532350108 wait complete. 2023-09-30T01:56:31.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff15c9ec700 1 Processor -- start 2023-09-30T01:56:31.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.655+0000 7ff15c9ec700 1 -- start start 2023-09-30T01:56:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15c9ec700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580a3d70 0x7ff158132340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15c9ec700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1580a9130 0x7ff15814fed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15c9ec700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff158136030 0x7ff158130c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15c9ec700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1580b5e60 con 0x7ff1580a3d70 2023-09-30T01:56:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15c9ec700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff158150870 con 0x7ff1580a9130 2023-09-30T01:56:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15c9ec700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff158150b30 con 0x7ff158136030 2023-09-30T01:56:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff156d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580a3d70 0x7ff158132340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff156d9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580a3d70 0x7ff158132340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54752/0 (socket says 172.21.15.55:54752) 2023-09-30T01:56:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15759e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff158136030 0x7ff158130c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:31.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff156d9d700 1 -- 172.21.15.55:0/1630531548 learned_addr learned my addr 172.21.15.55:0/1630531548 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15659c700 1 --2- 172.21.15.55:0/1630531548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1580a9130 0x7ff15814fed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15759e700 1 -- 172.21.15.55:0/1630531548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1580a9130 msgr2=0x7ff15814fed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15759e700 1 --2- 172.21.15.55:0/1630531548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1580a9130 0x7ff15814fed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15759e700 1 -- 172.21.15.55:0/1630531548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580a3d70 msgr2=0x7ff158132340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15759e700 1 --2- 172.21.15.55:0/1630531548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580a3d70 0x7ff158132340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15759e700 1 -- 172.21.15.55:0/1630531548 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1400094f0 con 0x7ff158136030 2023-09-30T01:56:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff156d9d700 1 --2- 172.21.15.55:0/1630531548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580a3d70 0x7ff158132340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15759e700 1 --2- 172.21.15.55:0/1630531548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff158136030 0x7ff158130c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff15000c790 tx=0x7ff1500015f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff14effd700 1 -- 172.21.15.55:0/1630531548 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150012630 con 0x7ff158136030 2023-09-30T01:56:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff14effd700 1 -- 172.21.15.55:0/1630531548 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1500127b0 con 0x7ff158136030 2023-09-30T01:56:31.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1630531548 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff158150e50 con 0x7ff158136030 2023-09-30T01:56:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff14effd700 1 -- 172.21.15.55:0/1630531548 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff150012b70 con 0x7ff158136030 2023-09-30T01:56:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1630531548 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1580b5ad0 con 0x7ff158136030 2023-09-30T01:56:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.659+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1630531548 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1580b6010 con 0x7ff158136030 2023-09-30T01:56:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.663+0000 7ff14effd700 1 -- 172.21.15.55:0/1630531548 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7ff150003030 con 0x7ff158136030 2023-09-30T01:56:31.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.663+0000 7ff14effd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.663+0000 7ff14effd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.663+0000 7ff14effd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.663+0000 7ff14effd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.663+0000 7ff14effd700 1 --2- 172.21.15.55:0/1630531548 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff13808e8e0 0x7ff138090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:31.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.663+0000 7ff156d9d700 1 --2- 172.21.15.55:0/1630531548 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff13808e8e0 0x7ff138090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:31.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.663+0000 7ff14effd700 1 -- 172.21.15.55:0/1630531548 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7ff1500b46e0 con 0x7ff158136030 2023-09-30T01:56:31.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.663+0000 7ff156d9d700 1 --2- 172.21.15.55:0/1630531548 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff13808e8e0 0x7ff138090d90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff14000c010 tx=0x7ff140017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:31.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.671+0000 7ff14effd700 1 -- 172.21.15.55:0/1630531548 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff1580b6010 con 0x7ff158136030 2023-09-30T01:56:31.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.867+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1630531548 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff1580b6010 con 0x7ff158136030 2023-09-30T01:56:31.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.867+0000 7ff14effd700 1 -- 172.21.15.55:0/1630531548 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7ff1580b6010 con 0x7ff158136030 2023-09-30T01:56:31.873 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:31.873 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:31.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.871+0000 7ff15c9ec700 10 mgrc shutdown 2023-09-30T01:56:31.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.871+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1630531548 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff13808e8e0 msgr2=0x7ff138090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:31.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.871+0000 7ff15c9ec700 1 --2- 172.21.15.55:0/1630531548 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff13808e8e0 0x7ff138090d90 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff14000c010 tx=0x7ff140017000 comp rx=0 tx=0).stop 2023-09-30T01:56:31.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.871+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1630531548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff158136030 msgr2=0x7ff158130c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:31.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.871+0000 7ff15c9ec700 1 --2- 172.21.15.55:0/1630531548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff158136030 0x7ff158130c20 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff15000c790 tx=0x7ff1500015f0 comp rx=0 tx=0).stop 2023-09-30T01:56:31.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.871+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1630531548 shutdown_connections 2023-09-30T01:56:31.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.871+0000 7ff15c9ec700 1 --2- 172.21.15.55:0/1630531548 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff13808e8e0 0x7ff138090d90 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:31.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.871+0000 7ff15c9ec700 1 --2- 172.21.15.55:0/1630531548 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff158136030 0x7ff158130c20 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:31.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.871+0000 7ff15c9ec700 1 --2- 172.21.15.55:0/1630531548 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff1580a9130 0x7ff15814fed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:31.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.871+0000 7ff15c9ec700 1 --2- 172.21.15.55:0/1630531548 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff1580a3d70 0x7ff158132340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:31.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.871+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1630531548 >> 172.21.15.55:0/1630531548 conn(0x7ff1580b6940 msgr2=0x7ff15806ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:31.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.871+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1630531548 shutdown_connections 2023-09-30T01:56:31.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:31.871+0000 7ff15c9ec700 1 -- 172.21.15.55:0/1630531548 wait complete. 2023-09-30T01:56:34.888 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.995+0000 7fc29ffff700 1 Processor -- start 2023-09-30T01:56:35.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.995+0000 7fc29ffff700 1 -- start start 2023-09-30T01:56:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc2a00a73f0 0x7fc2a0132b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29ffff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2a01330d0 0x7fc2a00a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29ffff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2a00a6d00 con 0x7fc2a00a8b00 2023-09-30T01:56:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29ffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2a00a77c0 con 0x7fc2a00a73f0 2023-09-30T01:56:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29ffff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00a45d0 con 0x7fc2a01330d0 2023-09-30T01:56:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29e7fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2a01330d0 0x7fc2a00a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29f7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc2a00a8b00 0x7fc2a00a6070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34098/0 (socket says 172.21.15.55:34098) 2023-09-30T01:56:35.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29f7fe700 1 -- 172.21.15.55:0/1736704826 learned_addr learned my addr 172.21.15.55:0/1736704826 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29effd700 1 --2- 172.21.15.55:0/1736704826 >> v2:172.21.15.133:3300/0 conn(0x7fc2a00a73f0 0x7fc2a0132b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29dffb700 1 -- 172.21.15.55:0/1736704826 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1107022326 0 0) 0x7fc2a00a6d00 con 0x7fc2a00a8b00 2023-09-30T01:56:35.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29dffb700 1 -- 172.21.15.55:0/1736704826 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc288003570 con 0x7fc2a00a8b00 2023-09-30T01:56:35.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29e7fc700 1 -- 172.21.15.55:0/1736704826 >> v2:172.21.15.133:3300/0 conn(0x7fc2a00a73f0 msgr2=0x7fc2a0132b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:35.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29e7fc700 1 --2- 172.21.15.55:0/1736704826 >> v2:172.21.15.133:3300/0 conn(0x7fc2a00a73f0 0x7fc2a0132b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:35.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29e7fc700 1 -- 172.21.15.55:0/1736704826 >> v1:172.21.15.55:6789/0 conn(0x7fc2a00a8b00 legacy=0x7fc2a00a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:35.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29e7fc700 1 -- 172.21.15.55:0/1736704826 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2a00a8f80 con 0x7fc2a01330d0 2023-09-30T01:56:35.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29e7fc700 1 --2- 172.21.15.55:0/1736704826 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2a01330d0 0x7fc2a00a85c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc2940098e0 tx=0x7fc2940091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9afe8c780f786d37 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:35.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29dffb700 1 -- 172.21.15.55:0/1736704826 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294012980 con 0x7fc2a01330d0 2023-09-30T01:56:35.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29dffb700 1 -- 172.21.15.55:0/1736704826 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc294012b00 con 0x7fc2a01330d0 2023-09-30T01:56:35.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29dffb700 1 -- 172.21.15.55:0/1736704826 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc29401b480 con 0x7fc2a01330d0 2023-09-30T01:56:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29ffff700 1 -- 172.21.15.55:0/1736704826 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2a01330d0 msgr2=0x7fc2a00a85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29ffff700 1 --2- 172.21.15.55:0/1736704826 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2a01330d0 0x7fc2a00a85c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fc2940098e0 tx=0x7fc2940091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29ffff700 1 -- 172.21.15.55:0/1736704826 shutdown_connections 2023-09-30T01:56:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29ffff700 1 --2- 172.21.15.55:0/1736704826 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2a01330d0 0x7fc2a00a85c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29ffff700 1 --2- 172.21.15.55:0/1736704826 >> v2:172.21.15.133:3300/0 conn(0x7fc2a00a73f0 0x7fc2a0132b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:35.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29ffff700 1 -- 172.21.15.55:0/1736704826 >> 172.21.15.55:0/1736704826 conn(0x7fc2a0062e20 msgr2=0x7fc2a0063220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29ffff700 1 -- 172.21.15.55:0/1736704826 shutdown_connections 2023-09-30T01:56:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:34.999+0000 7fc29ffff700 1 -- 172.21.15.55:0/1736704826 wait complete. 2023-09-30T01:56:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29ffff700 1 Processor -- start 2023-09-30T01:56:35.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29ffff700 1 -- start start 2023-09-30T01:56:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29ffff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2a00a73f0 0x7fc2a0140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a00a8b00 0x7fc2a00ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a01330d0 0x7fc2a012dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29ffff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00adc20 con 0x7fc2a00a8b00 2023-09-30T01:56:35.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a00addb0 con 0x7fc2a01330d0 2023-09-30T01:56:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29ffff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a014c0d0 con 0x7fc2a00a73f0 2023-09-30T01:56:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29e7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a00a8b00 0x7fc2a00ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29e7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a00a8b00 0x7fc2a00ae240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56066/0 (socket says 172.21.15.55:56066) 2023-09-30T01:56:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29e7fc700 1 -- 172.21.15.55:0/2257748123 learned_addr learned my addr 172.21.15.55:0/2257748123 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29effd700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2a00a73f0 0x7fc2a0140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:35.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29f7fe700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a01330d0 0x7fc2a012dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29e7fc700 1 -- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2a00a73f0 msgr2=0x7fc2a0140600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29e7fc700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2a00a73f0 0x7fc2a0140600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29e7fc700 1 -- 172.21.15.55:0/2257748123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a01330d0 msgr2=0x7fc2a012dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:35.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29e7fc700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a01330d0 0x7fc2a012dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:35.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29e7fc700 1 -- 172.21.15.55:0/2257748123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc294009420 con 0x7fc2a00a8b00 2023-09-30T01:56:35.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29effd700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2a00a73f0 0x7fc2a0140600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:35.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29e7fc700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a00a8b00 0x7fc2a00ae240 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc294017000 tx=0x7fc29401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:35.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc286ffd700 1 -- 172.21.15.55:0/2257748123 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc294012c70 con 0x7fc2a00a8b00 2023-09-30T01:56:35.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc286ffd700 1 -- 172.21.15.55:0/2257748123 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc294012dd0 con 0x7fc2a00a8b00 2023-09-30T01:56:35.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29ffff700 1 -- 172.21.15.55:0/2257748123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a014c390 con 0x7fc2a00a8b00 2023-09-30T01:56:35.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc286ffd700 1 -- 172.21.15.55:0/2257748123 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2940266a0 con 0x7fc2a00a8b00 2023-09-30T01:56:35.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.003+0000 7fc29ffff700 1 -- 172.21.15.55:0/2257748123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a014b980 con 0x7fc2a00a8b00 2023-09-30T01:56:35.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.007+0000 7fc29ffff700 1 -- 172.21.15.55:0/2257748123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a0064440 con 0x7fc2a00a8b00 2023-09-30T01:56:35.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.007+0000 7fc286ffd700 1 -- 172.21.15.55:0/2257748123 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc294022030 con 0x7fc2a00a8b00 2023-09-30T01:56:35.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.007+0000 7fc286ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:35.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.011+0000 7fc286ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.011+0000 7fc286ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.011+0000 7fc286ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.011+0000 7fc286ffd700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc28c08e8b0 0x7fc28c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.011+0000 7fc29effd700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc28c08e8b0 0x7fc28c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.011+0000 7fc286ffd700 1 -- 172.21.15.55:0/2257748123 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fc294016070 con 0x7fc2a00a8b00 2023-09-30T01:56:35.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.011+0000 7fc29effd700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc28c08e8b0 0x7fc28c090d60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc29800e9a0 tx=0x7fc29800b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:35.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.015+0000 7fc286ffd700 1 -- 172.21.15.55:0/2257748123 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc29408a210 con 0x7fc2a00a8b00 2023-09-30T01:56:35.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.215+0000 7fc29ffff700 1 -- 172.21.15.55:0/2257748123 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc2a00adef0 con 0x7fc2a00a8b00 2023-09-30T01:56:35.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.215+0000 7fc286ffd700 1 -- 172.21.15.55:0/2257748123 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fc29408d830 con 0x7fc2a00a8b00 2023-09-30T01:56:35.221 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:35.221 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.223+0000 7fc29ffff700 10 mgrc shutdown 2023-09-30T01:56:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.223+0000 7fc29ffff700 1 -- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc28c08e8b0 msgr2=0x7fc28c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.223+0000 7fc29ffff700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc28c08e8b0 0x7fc28c090d60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fc29800e9a0 tx=0x7fc29800b040 comp rx=0 tx=0).stop 2023-09-30T01:56:35.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.223+0000 7fc29ffff700 1 -- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a00a8b00 msgr2=0x7fc2a00ae240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.223+0000 7fc29ffff700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a00a8b00 0x7fc2a00ae240 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc294017000 tx=0x7fc29401b000 comp rx=0 tx=0).stop 2023-09-30T01:56:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.223+0000 7fc29ffff700 1 -- 172.21.15.55:0/2257748123 shutdown_connections 2023-09-30T01:56:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.223+0000 7fc29ffff700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc2a01330d0 0x7fc2a012dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.223+0000 7fc29ffff700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc2a00a8b00 0x7fc2a00ae240 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.223+0000 7fc29ffff700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc28c08e8b0 0x7fc28c090d60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.223+0000 7fc29ffff700 1 --2- 172.21.15.55:0/2257748123 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc2a00a73f0 0x7fc2a0140600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.223+0000 7fc29ffff700 1 -- 172.21.15.55:0/2257748123 >> 172.21.15.55:0/2257748123 conn(0x7fc2a0062e20 msgr2=0x7fc2a00b3900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.223+0000 7fc29ffff700 1 -- 172.21.15.55:0/2257748123 shutdown_connections 2023-09-30T01:56:35.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:35.223+0000 7fc29ffff700 1 -- 172.21.15.55:0/2257748123 wait complete. 2023-09-30T01:56:38.240 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:38.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.347+0000 7f01d710f700 1 Processor -- start 2023-09-30T01:56:38.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.347+0000 7f01d710f700 1 -- start start 2023-09-30T01:56:38.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d710f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01d00679e0 0x7f01d00a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:38.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d710f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01d00a5310 0x7f01d00a5750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:38.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d710f700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01d0067db0 con 0x7f01d00b1670 2023-09-30T01:56:38.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d710f700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01d0143930 con 0x7f01d00679e0 2023-09-30T01:56:38.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d710f700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0143bf0 con 0x7f01d00a5310 2023-09-30T01:56:38.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d610d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01d00679e0 0x7f01d00a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:38.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d590c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f01d00b1670 0x7f01d00b1a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34106/0 (socket says 172.21.15.55:34106) 2023-09-30T01:56:38.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d590c700 1 -- 172.21.15.55:0/3177208030 learned_addr learned my addr 172.21.15.55:0/3177208030 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:38.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d690e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01d00a5310 0x7f01d00a5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:38.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d510b700 1 -- 172.21.15.55:0/3177208030 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 868185431 0 0) 0x7f01d0067db0 con 0x7f01d00b1670 2023-09-30T01:56:38.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d510b700 1 -- 172.21.15.55:0/3177208030 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01bc003570 con 0x7f01d00b1670 2023-09-30T01:56:38.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d610d700 1 -- 172.21.15.55:0/3177208030 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01d00a5310 msgr2=0x7f01d00a5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:38.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d610d700 1 --2- 172.21.15.55:0/3177208030 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01d00a5310 0x7f01d00a5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:38.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d610d700 1 -- 172.21.15.55:0/3177208030 >> v1:172.21.15.55:6789/0 conn(0x7f01d00b1670 legacy=0x7f01d00b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:38.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d610d700 1 -- 172.21.15.55:0/3177208030 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01d006ac90 con 0x7f01d00679e0 2023-09-30T01:56:38.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d610d700 1 --2- 172.21.15.55:0/3177208030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d00679e0 0x7f01d00a44c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f01c00098e0 tx=0x7f01c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29f68b2e4a7d73a3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:38.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d510b700 1 -- 172.21.15.55:0/3177208030 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0011630 con 0x7f01d00679e0 2023-09-30T01:56:38.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d510b700 1 -- 172.21.15.55:0/3177208030 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c0011790 con 0x7f01d00679e0 2023-09-30T01:56:38.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d510b700 1 -- 172.21.15.55:0/3177208030 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c0011b30 con 0x7f01d00679e0 2023-09-30T01:56:38.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d710f700 1 -- 172.21.15.55:0/3177208030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d00679e0 msgr2=0x7f01d00a44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:38.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d710f700 1 --2- 172.21.15.55:0/3177208030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d00679e0 0x7f01d00a44c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f01c00098e0 tx=0x7f01c00091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:38.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d710f700 1 -- 172.21.15.55:0/3177208030 shutdown_connections 2023-09-30T01:56:38.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d710f700 1 --2- 172.21.15.55:0/3177208030 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01d00a5310 0x7f01d00a5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:38.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d710f700 1 --2- 172.21.15.55:0/3177208030 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d00679e0 0x7f01d00a44c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:38.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d710f700 1 -- 172.21.15.55:0/3177208030 >> 172.21.15.55:0/3177208030 conn(0x7f01d006ff20 msgr2=0x7f01d00670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:38.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d710f700 1 -- 172.21.15.55:0/3177208030 shutdown_connections 2023-09-30T01:56:38.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.351+0000 7f01d710f700 1 -- 172.21.15.55:0/3177208030 wait complete. 2023-09-30T01:56:38.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d710f700 1 Processor -- start 2023-09-30T01:56:38.358 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d710f700 1 -- start start 2023-09-30T01:56:38.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d710f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d00679e0 0x7f01d011fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:38.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d710f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01d00a5310 0x7f01d0144f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:38.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d710f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d00b1670 0x7f01d0145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:38.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d710f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0145980 con 0x7f01d00b1670 2023-09-30T01:56:38.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d710f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0145e50 con 0x7f01d00679e0 2023-09-30T01:56:38.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d710f700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01d0145b90 con 0x7f01d00a5310 2023-09-30T01:56:38.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d690e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d00b1670 0x7f01d0145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:38.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d590c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01d00a5310 0x7f01d0144f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:38.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d690e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d00b1670 0x7f01d0145440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56084/0 (socket says 172.21.15.55:56084) 2023-09-30T01:56:38.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d690e700 1 -- 172.21.15.55:0/4031123709 learned_addr learned my addr 172.21.15.55:0/4031123709 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:38.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d610d700 1 --2- 172.21.15.55:0/4031123709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d00679e0 0x7f01d011fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:38.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d690e700 1 -- 172.21.15.55:0/4031123709 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01d00a5310 msgr2=0x7f01d0144f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:38.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d690e700 1 --2- 172.21.15.55:0/4031123709 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01d00a5310 0x7f01d0144f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:38.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d690e700 1 -- 172.21.15.55:0/4031123709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d00679e0 msgr2=0x7f01d011fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:38.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d690e700 1 --2- 172.21.15.55:0/4031123709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d00679e0 0x7f01d011fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:38.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.355+0000 7f01d690e700 1 -- 172.21.15.55:0/4031123709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01c0009420 con 0x7f01d00b1670 2023-09-30T01:56:38.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01d690e700 1 --2- 172.21.15.55:0/4031123709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d00b1670 0x7f01d0145440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009e90 tx=0x7f01c800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:38.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01c67fc700 1 -- 172.21.15.55:0/4031123709 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c800cb70 con 0x7f01d00b1670 2023-09-30T01:56:38.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01c67fc700 1 -- 172.21.15.55:0/4031123709 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01c800f040 con 0x7f01d00b1670 2023-09-30T01:56:38.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01d710f700 1 -- 172.21.15.55:0/4031123709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01d011c5c0 con 0x7f01d00b1670 2023-09-30T01:56:38.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01c67fc700 1 -- 172.21.15.55:0/4031123709 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01c8014480 con 0x7f01d00b1670 2023-09-30T01:56:38.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01d710f700 1 -- 172.21.15.55:0/4031123709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01d0120350 con 0x7f01d00b1670 2023-09-30T01:56:38.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01d710f700 1 -- 172.21.15.55:0/4031123709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01d0064440 con 0x7f01d00b1670 2023-09-30T01:56:38.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01c67fc700 1 -- 172.21.15.55:0/4031123709 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f01c8014830 con 0x7f01d00b1670 2023-09-30T01:56:38.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01c67fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:38.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01c67fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:38.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01c67fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:38.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01c67fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:38.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01c67fc700 1 --2- 172.21.15.55:0/4031123709 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f01b408e8b0 0x7f01b4090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:38.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01c67fc700 1 -- 172.21.15.55:0/4031123709 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7f01c80b5160 con 0x7f01d00b1670 2023-09-30T01:56:38.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.359+0000 7f01d610d700 1 --2- 172.21.15.55:0/4031123709 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f01b408e8b0 0x7f01b4090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:38.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.363+0000 7f01d610d700 1 --2- 172.21.15.55:0/4031123709 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f01b408e8b0 0x7f01b4090d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f01c00091e0 tx=0x7f01c0017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:38.371 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.367+0000 7f01c67fc700 1 -- 172.21.15.55:0/4031123709 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f01c8085c20 con 0x7f01d00b1670 2023-09-30T01:56:38.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.559+0000 7f01d710f700 1 -- 172.21.15.55:0/4031123709 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f01d00a4ba0 con 0x7f01d00b1670 2023-09-30T01:56:38.565 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.563+0000 7f01c67fc700 1 -- 172.21.15.55:0/4031123709 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f01c8089240 con 0x7f01d00b1670 2023-09-30T01:56:38.566 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:38.566 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:38.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.563+0000 7f01d710f700 10 mgrc shutdown 2023-09-30T01:56:38.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.563+0000 7f01d710f700 1 -- 172.21.15.55:0/4031123709 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f01b408e8b0 msgr2=0x7f01b4090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:38.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.563+0000 7f01d710f700 1 --2- 172.21.15.55:0/4031123709 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f01b408e8b0 0x7f01b4090d60 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f01c00091e0 tx=0x7f01c0017000 comp rx=0 tx=0).stop 2023-09-30T01:56:38.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.563+0000 7f01d710f700 1 -- 172.21.15.55:0/4031123709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d00b1670 msgr2=0x7f01d0145440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:38.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.563+0000 7f01d710f700 1 --2- 172.21.15.55:0/4031123709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d00b1670 0x7f01d0145440 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f01c8009e90 tx=0x7f01c800b040 comp rx=0 tx=0).stop 2023-09-30T01:56:38.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.563+0000 7f01d710f700 1 -- 172.21.15.55:0/4031123709 shutdown_connections 2023-09-30T01:56:38.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.563+0000 7f01d710f700 1 --2- 172.21.15.55:0/4031123709 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01d00b1670 0x7f01d0145440 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:38.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.563+0000 7f01d710f700 1 --2- 172.21.15.55:0/4031123709 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f01b408e8b0 0x7f01b4090d60 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:38.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.563+0000 7f01d710f700 1 --2- 172.21.15.55:0/4031123709 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01d00a5310 0x7f01d0144f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:38.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.563+0000 7f01d710f700 1 --2- 172.21.15.55:0/4031123709 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01d00679e0 0x7f01d011fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:38.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.563+0000 7f01d710f700 1 -- 172.21.15.55:0/4031123709 >> 172.21.15.55:0/4031123709 conn(0x7f01d006ff20 msgr2=0x7f01d00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:38.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.563+0000 7f01d710f700 1 -- 172.21.15.55:0/4031123709 shutdown_connections 2023-09-30T01:56:38.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:38.563+0000 7f01d710f700 1 -- 172.21.15.55:0/4031123709 wait complete. 2023-09-30T01:56:41.584 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:41.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.691+0000 7fd135e63700 1 Processor -- start 2023-09-30T01:56:41.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.691+0000 7fd135e63700 1 -- start start 2023-09-30T01:56:41.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135e63700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd130070150 0x7fd13006b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:41.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135e63700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd1300a5cb0 0x7fd1301475d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:41.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135e63700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd130070520 con 0x7fd13006db80 2023-09-30T01:56:41.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135e63700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd13006c240 con 0x7fd1300a5cb0 2023-09-30T01:56:41.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135e63700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13006c4e0 con 0x7fd130070150 2023-09-30T01:56:41.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135662700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd1300a5cb0 0x7fd1301475d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:41.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd134e61700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd130070150 0x7fd13006b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:41.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd12ffff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fd13006db80 0x7fd13013c100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34114/0 (socket says 172.21.15.55:34114) 2023-09-30T01:56:41.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd12ffff700 1 -- 172.21.15.55:0/3509821998 learned_addr learned my addr 172.21.15.55:0/3509821998 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:41.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd134e61700 1 -- 172.21.15.55:0/3509821998 >> v2:172.21.15.55:3300/0 conn(0x7fd1300a5cb0 msgr2=0x7fd1301475d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:41.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd134e61700 1 --2- 172.21.15.55:0/3509821998 >> v2:172.21.15.55:3300/0 conn(0x7fd1300a5cb0 0x7fd1301475d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:41.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd134e61700 1 -- 172.21.15.55:0/3509821998 >> v1:172.21.15.55:6789/0 conn(0x7fd13006db80 legacy=0x7fd13013c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:41.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd12f7fe700 1 -- 172.21.15.55:0/3509821998 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1241070660 0 0) 0x7fd130070520 con 0x7fd13006db80 2023-09-30T01:56:41.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd134e61700 1 -- 172.21.15.55:0/3509821998 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13006bf30 con 0x7fd130070150 2023-09-30T01:56:41.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135662700 1 --2- 172.21.15.55:0/3509821998 >> v2:172.21.15.55:3300/0 conn(0x7fd1300a5cb0 0x7fd1301475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:41.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd134e61700 1 --2- 172.21.15.55:0/3509821998 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd130070150 0x7fd13006b9f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd1240098d0 tx=0x7fd124009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b76774fdf4c894bd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:41.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd12f7fe700 1 -- 172.21.15.55:0/3509821998 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124005c10 con 0x7fd130070150 2023-09-30T01:56:41.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd12f7fe700 1 -- 172.21.15.55:0/3509821998 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd124005d70 con 0x7fd130070150 2023-09-30T01:56:41.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd12f7fe700 1 -- 172.21.15.55:0/3509821998 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd124006280 con 0x7fd130070150 2023-09-30T01:56:41.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135e63700 1 -- 172.21.15.55:0/3509821998 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd130070150 msgr2=0x7fd13006b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:41.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135e63700 1 --2- 172.21.15.55:0/3509821998 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd130070150 0x7fd13006b9f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd1240098d0 tx=0x7fd124009120 comp rx=0 tx=0).stop 2023-09-30T01:56:41.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135e63700 1 -- 172.21.15.55:0/3509821998 shutdown_connections 2023-09-30T01:56:41.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135e63700 1 --2- 172.21.15.55:0/3509821998 >> v2:172.21.15.55:3300/0 conn(0x7fd1300a5cb0 0x7fd1301475d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135e63700 1 --2- 172.21.15.55:0/3509821998 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd130070150 0x7fd13006b9f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135e63700 1 -- 172.21.15.55:0/3509821998 >> 172.21.15.55:0/3509821998 conn(0x7fd1300b2cf0 msgr2=0x7fd1300b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135e63700 1 -- 172.21.15.55:0/3509821998 shutdown_connections 2023-09-30T01:56:41.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.695+0000 7fd135e63700 1 -- 172.21.15.55:0/3509821998 wait complete. 2023-09-30T01:56:41.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd135e63700 1 Processor -- start 2023-09-30T01:56:41.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd135e63700 1 -- start start 2023-09-30T01:56:41.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd135e63700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13006db80 0x7fd1300a1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:41.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd135e63700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd130070150 0x7fd13013ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:41.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd135e63700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1300a5cb0 0x7fd13012bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:41.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd135e63700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13013f400 con 0x7fd130070150 2023-09-30T01:56:41.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd135e63700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd13013f6c0 con 0x7fd13006db80 2023-09-30T01:56:41.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd135e63700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd13012ce70 con 0x7fd1300a5cb0 2023-09-30T01:56:41.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd135662700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1300a5cb0 0x7fd13012bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:41.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd12ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd130070150 0x7fd13013ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:41.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd135662700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1300a5cb0 0x7fd13012bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43606/0 (socket says 172.21.15.55:43606) 2023-09-30T01:56:41.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd135662700 1 -- 172.21.15.55:0/3626868879 learned_addr learned my addr 172.21.15.55:0/3626868879 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:41.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd12ffff700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd130070150 0x7fd13013ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:56092/0 (socket says 172.21.15.55:56092) 2023-09-30T01:56:41.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd134e61700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13006db80 0x7fd1300a1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:41.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd12ffff700 1 -- 172.21.15.55:0/3626868879 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1300a5cb0 msgr2=0x7fd13012bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:41.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd12ffff700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1300a5cb0 0x7fd13012bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:41.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd12ffff700 1 -- 172.21.15.55:0/3626868879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13006db80 msgr2=0x7fd1300a1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:41.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd12ffff700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13006db80 0x7fd1300a1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:41.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd12ffff700 1 -- 172.21.15.55:0/3626868879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd128009a20 con 0x7fd130070150 2023-09-30T01:56:41.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.699+0000 7fd134e61700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13006db80 0x7fd1300a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:56:41.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.703+0000 7fd12ffff700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd130070150 0x7fd13013ed20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0011e0 tx=0x7fd11c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:41.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.703+0000 7fd12cff9700 1 -- 172.21.15.55:0/3626868879 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c005b30 con 0x7fd130070150 2023-09-30T01:56:41.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.703+0000 7fd12cff9700 1 -- 172.21.15.55:0/3626868879 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd11c005c90 con 0x7fd130070150 2023-09-30T01:56:41.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.703+0000 7fd135e63700 1 -- 172.21.15.55:0/3626868879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1240093c0 con 0x7fd130070150 2023-09-30T01:56:41.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.703+0000 7fd12cff9700 1 -- 172.21.15.55:0/3626868879 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd11c007300 con 0x7fd130070150 2023-09-30T01:56:41.707 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.703+0000 7fd135e63700 1 -- 172.21.15.55:0/3626868879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1300a29a0 con 0x7fd130070150 2023-09-30T01:56:41.708 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.703+0000 7fd135e63700 1 -- 172.21.15.55:0/3626868879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd130064440 con 0x7fd130070150 2023-09-30T01:56:41.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.707+0000 7fd12cff9700 1 -- 172.21.15.55:0/3626868879 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fd11c01b3b0 con 0x7fd130070150 2023-09-30T01:56:41.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.707+0000 7fd12cff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.707+0000 7fd12cff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.707+0000 7fd12cff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.707+0000 7fd12cff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.707+0000 7fd12cff9700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd11408e8b0 0x7fd114090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.707+0000 7fd134e61700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd11408e8b0 0x7fd114090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:41.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.707+0000 7fd12cff9700 1 -- 172.21.15.55:0/3626868879 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 4330+0+0 (secure 0 0 0) 0x7fd11c0b41c0 con 0x7fd130070150 2023-09-30T01:56:41.712 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.707+0000 7fd134e61700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd11408e8b0 0x7fd114090d60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd124009160 tx=0x7fd124016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:41.714 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.711+0000 7fd12cff9700 1 -- 172.21.15.55:0/3626868879 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd11c084b50 con 0x7fd130070150 2023-09-30T01:56:41.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.903+0000 7fd135e63700 1 -- 172.21.15.55:0/3626868879 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd1300686c0 con 0x7fd130070150 2023-09-30T01:56:41.909 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.907+0000 7fd12cff9700 1 -- 172.21.15.55:0/3626868879 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fd11c017080 con 0x7fd130070150 2023-09-30T01:56:41.910 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:41.910 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.907+0000 7fd135e63700 10 mgrc shutdown 2023-09-30T01:56:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.907+0000 7fd135e63700 1 -- 172.21.15.55:0/3626868879 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd11408e8b0 msgr2=0x7fd114090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.907+0000 7fd135e63700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd11408e8b0 0x7fd114090d60 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd124009160 tx=0x7fd124016000 comp rx=0 tx=0).stop 2023-09-30T01:56:41.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.907+0000 7fd135e63700 1 -- 172.21.15.55:0/3626868879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd130070150 msgr2=0x7fd13013ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.907+0000 7fd135e63700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd130070150 0x7fd13013ed20 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fd11c0011e0 tx=0x7fd11c007d30 comp rx=0 tx=0).stop 2023-09-30T01:56:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.907+0000 7fd135e63700 1 -- 172.21.15.55:0/3626868879 shutdown_connections 2023-09-30T01:56:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.907+0000 7fd135e63700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd11408e8b0 0x7fd114090d60 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.907+0000 7fd135e63700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd1300a5cb0 0x7fd13012bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.907+0000 7fd135e63700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd130070150 0x7fd13013ed20 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.907+0000 7fd135e63700 1 --2- 172.21.15.55:0/3626868879 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd13006db80 0x7fd1300a1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.907+0000 7fd135e63700 1 -- 172.21.15.55:0/3626868879 >> 172.21.15.55:0/3626868879 conn(0x7fd1300b2cf0 msgr2=0x7fd13006ed80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.907+0000 7fd135e63700 1 -- 172.21.15.55:0/3626868879 shutdown_connections 2023-09-30T01:56:41.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:41.907+0000 7fd135e63700 1 -- 172.21.15.55:0/3626868879 wait complete. 2023-09-30T01:56:43.819 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:56:43.821 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:56:44.929 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:45.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.039+0000 7fe213d80700 1 Processor -- start 2023-09-30T01:56:45.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.039+0000 7fe213d80700 1 -- start start 2023-09-30T01:56:45.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.039+0000 7fe213d80700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe20c0b3060 0x7fe20c06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:45.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.039+0000 7fe213d80700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe20c1481d0 0x7fe20c13a840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.039+0000 7fe213d80700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe20c06daf0 con 0x7fe20c13a400 2023-09-30T01:56:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.039+0000 7fe213d80700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe20c1489d0 con 0x7fe20c0b3060 2023-09-30T01:56:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.039+0000 7fe213d80700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c13ad80 con 0x7fe20c1481d0 2023-09-30T01:56:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.039+0000 7fe211b1c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe20c0b3060 0x7fe20c06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.039+0000 7fe21231d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe20c1481d0 0x7fe20c13a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.039+0000 7fe211b1c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fe20c0b3060 0x7fe20c06d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33920/0 (socket says 172.21.15.55:33920) 2023-09-30T01:56:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.039+0000 7fe21231d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe20c1481d0 0x7fe20c13a840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:46162/0 (socket says 172.21.15.55:46162) 2023-09-30T01:56:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.039+0000 7fe211b1c700 1 -- 172.21.15.55:0/18322813 learned_addr learned my addr 172.21.15.55:0/18322813 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe211b1c700 1 -- 172.21.15.55:0/18322813 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe20c1481d0 msgr2=0x7fe20c13a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:45.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe211b1c700 1 --2- 172.21.15.55:0/18322813 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe20c1481d0 0x7fe20c13a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:45.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe211b1c700 1 -- 172.21.15.55:0/18322813 >> v1:172.21.15.133:6789/0 conn(0x7fe20c13a400 legacy=0x7fe20c147ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:45.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe211b1c700 1 -- 172.21.15.55:0/18322813 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe20c06d910 con 0x7fe20c0b3060 2023-09-30T01:56:45.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe21231d700 1 --2- 172.21.15.55:0/18322813 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe20c1481d0 0x7fe20c13a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:45.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe211b1c700 1 --2- 172.21.15.55:0/18322813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20c0b3060 0x7fe20c06d3d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe2000099b0 tx=0x7fe200009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1433e04be2c61058 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe210b1a700 1 -- 172.21.15.55:0/18322813 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200009ea0 con 0x7fe20c0b3060 2023-09-30T01:56:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe210b1a700 1 -- 172.21.15.55:0/18322813 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20000b860 con 0x7fe20c0b3060 2023-09-30T01:56:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe210b1a700 1 -- 172.21.15.55:0/18322813 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe20000bc00 con 0x7fe20c0b3060 2023-09-30T01:56:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe213d80700 1 -- 172.21.15.55:0/18322813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20c0b3060 msgr2=0x7fe20c06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe213d80700 1 --2- 172.21.15.55:0/18322813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20c0b3060 0x7fe20c06d3d0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fe2000099b0 tx=0x7fe200009250 comp rx=0 tx=0).stop 2023-09-30T01:56:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe213d80700 1 -- 172.21.15.55:0/18322813 shutdown_connections 2023-09-30T01:56:45.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe213d80700 1 --2- 172.21.15.55:0/18322813 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe20c1481d0 0x7fe20c13a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:45.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe213d80700 1 --2- 172.21.15.55:0/18322813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20c0b3060 0x7fe20c06d3d0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:45.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe213d80700 1 -- 172.21.15.55:0/18322813 >> 172.21.15.55:0/18322813 conn(0x7fe20c068b00 msgr2=0x7fe20c0b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:45.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe213d80700 1 -- 172.21.15.55:0/18322813 shutdown_connections 2023-09-30T01:56:45.049 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe213d80700 1 -- 172.21.15.55:0/18322813 wait complete. 2023-09-30T01:56:45.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe213d80700 1 Processor -- start 2023-09-30T01:56:45.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.043+0000 7fe213d80700 1 -- start start 2023-09-30T01:56:45.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe213d80700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20c0b3060 0x7fe20c0a7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:45.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe213d80700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe20c13a400 0x7fe20c0ae6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:45.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe213d80700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20c1481d0 0x7fe20c0acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:45.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe213d80700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c14a8b0 con 0x7fe20c1481d0 2023-09-30T01:56:45.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe213d80700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c0a7fa0 con 0x7fe20c0b3060 2023-09-30T01:56:45.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe213d80700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe20c0a9630 con 0x7fe20c13a400 2023-09-30T01:56:45.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe21231d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20c1481d0 0x7fe20c0acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:45.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe21231d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20c1481d0 0x7fe20c0acbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33930/0 (socket says 172.21.15.55:33930) 2023-09-30T01:56:45.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe21231d700 1 -- 172.21.15.55:0/3144627152 learned_addr learned my addr 172.21.15.55:0/3144627152 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:45.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe21131b700 1 --2- 172.21.15.55:0/3144627152 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe20c13a400 0x7fe20c0ae6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:45.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe211b1c700 1 --2- 172.21.15.55:0/3144627152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20c0b3060 0x7fe20c0a7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:45.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe211b1c700 1 -- 172.21.15.55:0/3144627152 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe20c13a400 msgr2=0x7fe20c0ae6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:45.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe211b1c700 1 --2- 172.21.15.55:0/3144627152 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe20c13a400 0x7fe20c0ae6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:45.052 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe211b1c700 1 -- 172.21.15.55:0/3144627152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20c1481d0 msgr2=0x7fe20c0acbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:45.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe211b1c700 1 --2- 172.21.15.55:0/3144627152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20c1481d0 0x7fe20c0acbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:45.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe211b1c700 1 -- 172.21.15.55:0/3144627152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe204009a20 con 0x7fe20c0b3060 2023-09-30T01:56:45.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe211b1c700 1 --2- 172.21.15.55:0/3144627152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20c0b3060 0x7fe20c0a7930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe20c063b60 tx=0x7fe200017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:45.053 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe1fdffb700 1 -- 172.21.15.55:0/3144627152 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200000d10 con 0x7fe20c0b3060 2023-09-30T01:56:45.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe1fdffb700 1 -- 172.21.15.55:0/3144627152 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe20000bbe0 con 0x7fe20c0b3060 2023-09-30T01:56:45.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe213d80700 1 -- 172.21.15.55:0/3144627152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2000094f0 con 0x7fe20c0b3060 2023-09-30T01:56:45.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe1fdffb700 1 -- 172.21.15.55:0/3144627152 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe200011670 con 0x7fe20c0b3060 2023-09-30T01:56:45.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.047+0000 7fe213d80700 1 -- 172.21.15.55:0/3144627152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20c0ae250 con 0x7fe20c0b3060 2023-09-30T01:56:45.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.051+0000 7fe213d80700 1 -- 172.21.15.55:0/3144627152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe20c068300 con 0x7fe20c0b3060 2023-09-30T01:56:45.054 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.051+0000 7fe1fdffb700 1 -- 172.21.15.55:0/3144627152 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fe200011aa0 con 0x7fe20c0b3060 2023-09-30T01:56:45.055 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.051+0000 7fe1fdffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.051+0000 7fe1fdffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.051+0000 7fe1fdffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.051+0000 7fe1fdffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.051+0000 7fe1fdffb700 1 --2- 172.21.15.55:0/3144627152 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe1f008e8b0 0x7fe1f0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.051+0000 7fe21131b700 1 --2- 172.21.15.55:0/3144627152 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe1f008e8b0 0x7fe1f0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.051+0000 7fe1fdffb700 1 -- 172.21.15.55:0/3144627152 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fe2000b5f00 con 0x7fe20c0b3060 2023-09-30T01:56:45.056 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.051+0000 7fe21131b700 1 --2- 172.21.15.55:0/3144627152 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe1f008e8b0 0x7fe1f0090d60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe20c147ea0 tx=0x7fe208009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:45.064 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.059+0000 7fe1fdffb700 1 -- 172.21.15.55:0/3144627152 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe200086930 con 0x7fe20c0b3060 2023-09-30T01:56:45.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.255+0000 7fe213d80700 1 -- 172.21.15.55:0/3144627152 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe20c06c930 con 0x7fe20c0b3060 2023-09-30T01:56:45.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.255+0000 7fe1fdffb700 1 -- 172.21.15.55:0/3144627152 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fe200089f50 con 0x7fe20c0b3060 2023-09-30T01:56:45.261 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:45.261 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:45.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.259+0000 7fe213d80700 10 mgrc shutdown 2023-09-30T01:56:45.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.259+0000 7fe213d80700 1 -- 172.21.15.55:0/3144627152 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe1f008e8b0 msgr2=0x7fe1f0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:45.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.259+0000 7fe213d80700 1 --2- 172.21.15.55:0/3144627152 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe1f008e8b0 0x7fe1f0090d60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fe20c147ea0 tx=0x7fe208009040 comp rx=0 tx=0).stop 2023-09-30T01:56:45.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.259+0000 7fe213d80700 1 -- 172.21.15.55:0/3144627152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20c0b3060 msgr2=0x7fe20c0a7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:45.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.259+0000 7fe213d80700 1 --2- 172.21.15.55:0/3144627152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20c0b3060 0x7fe20c0a7930 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe20c063b60 tx=0x7fe200017000 comp rx=0 tx=0).stop 2023-09-30T01:56:45.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.259+0000 7fe213d80700 1 -- 172.21.15.55:0/3144627152 shutdown_connections 2023-09-30T01:56:45.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.259+0000 7fe213d80700 1 --2- 172.21.15.55:0/3144627152 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe20c1481d0 0x7fe20c0acbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:45.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.259+0000 7fe213d80700 1 --2- 172.21.15.55:0/3144627152 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe1f008e8b0 0x7fe1f0090d60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:45.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.259+0000 7fe213d80700 1 --2- 172.21.15.55:0/3144627152 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe20c13a400 0x7fe20c0ae6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:45.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.259+0000 7fe213d80700 1 --2- 172.21.15.55:0/3144627152 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe20c0b3060 0x7fe20c0a7930 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:45.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.259+0000 7fe213d80700 1 -- 172.21.15.55:0/3144627152 >> 172.21.15.55:0/3144627152 conn(0x7fe20c068b00 msgr2=0x7fe20c0b2700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:45.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.259+0000 7fe213d80700 1 -- 172.21.15.55:0/3144627152 shutdown_connections 2023-09-30T01:56:45.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:45.259+0000 7fe213d80700 1 -- 172.21.15.55:0/3144627152 wait complete. 2023-09-30T01:56:48.277 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:48.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284bfff700 1 Processor -- start 2023-09-30T01:56:48.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284bfff700 1 -- start start 2023-09-30T01:56:48.396 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284bfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f284c0a0d80 0x7f284c0a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:48.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284bfff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c13e6f0 0x7f284c0a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:48.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284bfff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c09f480 con 0x7f284c0a1150 2023-09-30T01:56:48.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284bfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c09f740 con 0x7f284c0a0d80 2023-09-30T01:56:48.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284bfff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c06e040 con 0x7f284c13e6f0 2023-09-30T01:56:48.397 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284a7fc700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f284c0a1150 0x7f284c13dfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34190/0 (socket says 172.21.15.55:34190) 2023-09-30T01:56:48.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284b7fe700 1 --2- 172.21.15.55:0/1478444620 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c13e6f0 0x7f284c0a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:48.398 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284a7fc700 1 -- 172.21.15.55:0/1478444620 learned_addr learned my addr 172.21.15.55:0/1478444620 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:48.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284affd700 1 --2- 172.21.15.55:0/1478444620 >> v2:172.21.15.133:3300/0 conn(0x7f284c0a0d80 0x7f284c0a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:48.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f2849ffb700 1 -- 172.21.15.55:0/1478444620 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3129988308 0 0) 0x7f284c09f480 con 0x7f284c0a1150 2023-09-30T01:56:48.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f2849ffb700 1 -- 172.21.15.55:0/1478444620 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2834003570 con 0x7f284c0a1150 2023-09-30T01:56:48.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284b7fe700 1 -- 172.21.15.55:0/1478444620 >> v2:172.21.15.133:3300/0 conn(0x7f284c0a0d80 msgr2=0x7f284c0a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:48.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284b7fe700 1 --2- 172.21.15.55:0/1478444620 >> v2:172.21.15.133:3300/0 conn(0x7f284c0a0d80 0x7f284c0a4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:48.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284b7fe700 1 -- 172.21.15.55:0/1478444620 >> v1:172.21.15.55:6789/0 conn(0x7f284c0a1150 legacy=0x7f284c13dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:48.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f2849ffb700 1 -- 172.21.15.55:0/1478444620 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1842169281 0 0) 0x7f2834003570 con 0x7f284c0a1150 2023-09-30T01:56:48.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284b7fe700 1 -- 172.21.15.55:0/1478444620 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c0a2240 con 0x7f284c13e6f0 2023-09-30T01:56:48.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284affd700 1 --2- 172.21.15.55:0/1478444620 >> v2:172.21.15.133:3300/0 conn(0x7f284c0a0d80 0x7f284c0a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:56:48.400 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f284b7fe700 1 --2- 172.21.15.55:0/1478444620 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c13e6f0 0x7f284c0a4fd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2844009910 tx=0x7f28440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ebb85e057b6bc204 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:48.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f2849ffb700 1 -- 172.21.15.55:0/1478444620 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283c0017f0 con 0x7f284c13e6f0 2023-09-30T01:56:48.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f2849ffb700 1 -- 172.21.15.55:0/1478444620 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2844011420 con 0x7f284c13e6f0 2023-09-30T01:56:48.401 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.391+0000 7f2849ffb700 1 -- 172.21.15.55:0/1478444620 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28440117a0 con 0x7f284c13e6f0 2023-09-30T01:56:48.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 -- 172.21.15.55:0/1478444620 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c13e6f0 msgr2=0x7f284c0a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:48.405 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 --2- 172.21.15.55:0/1478444620 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c13e6f0 0x7f284c0a4fd0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f2844009910 tx=0x7f28440091a0 comp rx=0 tx=0).stop 2023-09-30T01:56:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 -- 172.21.15.55:0/1478444620 shutdown_connections 2023-09-30T01:56:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 --2- 172.21.15.55:0/1478444620 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c13e6f0 0x7f284c0a4fd0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 --2- 172.21.15.55:0/1478444620 >> v2:172.21.15.133:3300/0 conn(0x7f284c0a0d80 0x7f284c0a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 -- 172.21.15.55:0/1478444620 >> 172.21.15.55:0/1478444620 conn(0x7f284c0b23d0 msgr2=0x7f284c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 -- 172.21.15.55:0/1478444620 shutdown_connections 2023-09-30T01:56:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 -- 172.21.15.55:0/1478444620 wait complete. 2023-09-30T01:56:48.406 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 Processor -- start 2023-09-30T01:56:48.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 -- start start 2023-09-30T01:56:48.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0a0d80 0x7f284c099190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:48.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f284c0a1150 0x7f284c09b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:48.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f284c13e6f0 0x7f284c099dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:48.407 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c09be60 con 0x7f284c13e6f0 2023-09-30T01:56:48.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c09ae20 con 0x7f284c0a1150 2023-09-30T01:56:48.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284bfff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c099850 con 0x7f284c0a0d80 2023-09-30T01:56:48.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284b7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f284c13e6f0 0x7f284c099dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:48.408 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284b7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f284c13e6f0 0x7f284c099dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33940/0 (socket says 172.21.15.55:33940) 2023-09-30T01:56:48.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284b7fe700 1 -- 172.21.15.55:0/1903873628 learned_addr learned my addr 172.21.15.55:0/1903873628 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:48.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284affd700 1 --2- 172.21.15.55:0/1903873628 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0a0d80 0x7f284c099190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:48.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.395+0000 7f284a7fc700 1 --2- 172.21.15.55:0/1903873628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f284c0a1150 0x7f284c09b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:48.409 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.399+0000 7f284affd700 1 -- 172.21.15.55:0/1903873628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f284c0a1150 msgr2=0x7f284c09b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:48.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.399+0000 7f284affd700 1 --2- 172.21.15.55:0/1903873628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f284c0a1150 0x7f284c09b600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:48.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.399+0000 7f284affd700 1 -- 172.21.15.55:0/1903873628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f284c13e6f0 msgr2=0x7f284c099dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:48.410 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.399+0000 7f284affd700 1 --2- 172.21.15.55:0/1903873628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f284c13e6f0 0x7f284c099dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:48.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.399+0000 7f284affd700 1 -- 172.21.15.55:0/1903873628 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844009420 con 0x7f284c0a0d80 2023-09-30T01:56:48.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.399+0000 7f284affd700 1 --2- 172.21.15.55:0/1903873628 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0a0d80 0x7f284c099190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2840006fd0 tx=0x7f2840008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:48.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.399+0000 7f2832ffd700 1 -- 172.21.15.55:0/1903873628 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840013410 con 0x7f284c0a0d80 2023-09-30T01:56:48.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.399+0000 7f2832ffd700 1 -- 172.21.15.55:0/1903873628 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2840013570 con 0x7f284c0a0d80 2023-09-30T01:56:48.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.399+0000 7f284bfff700 1 -- 172.21.15.55:0/1903873628 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284c099b10 con 0x7f284c0a0d80 2023-09-30T01:56:48.411 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.399+0000 7f2832ffd700 1 -- 172.21.15.55:0/1903873628 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28400138f0 con 0x7f284c0a0d80 2023-09-30T01:56:48.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.399+0000 7f284bfff700 1 -- 172.21.15.55:0/1903873628 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c09b100 con 0x7f284c0a0d80 2023-09-30T01:56:48.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.399+0000 7f284bfff700 1 -- 172.21.15.55:0/1903873628 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c064440 con 0x7f284c0a0d80 2023-09-30T01:56:48.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.399+0000 7f2832ffd700 1 -- 172.21.15.55:0/1903873628 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f2840013ce0 con 0x7f284c0a0d80 2023-09-30T01:56:48.412 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.399+0000 7f2832ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:48.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.403+0000 7f2832ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:48.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.403+0000 7f2832ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:48.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.403+0000 7f2832ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:48.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.403+0000 7f2832ffd700 1 --2- 172.21.15.55:0/1903873628 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f283808e8b0 0x7f2838090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:48.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.403+0000 7f284a7fc700 1 --2- 172.21.15.55:0/1903873628 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f283808e8b0 0x7f2838090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:48.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.403+0000 7f2832ffd700 1 -- 172.21.15.55:0/1903873628 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f28400b4490 con 0x7f284c0a0d80 2023-09-30T01:56:48.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.403+0000 7f284a7fc700 1 --2- 172.21.15.55:0/1903873628 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f283808e8b0 0x7f2838090d60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f284c13da30 tx=0x7f283c007c70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:48.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.407+0000 7f2832ffd700 1 -- 172.21.15.55:0/1903873628 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2840084e10 con 0x7f284c0a0d80 2023-09-30T01:56:48.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.603+0000 7f284bfff700 1 -- 172.21.15.55:0/1903873628 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f284c13da60 con 0x7f284c0a0d80 2023-09-30T01:56:48.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.603+0000 7f2832ffd700 1 -- 172.21.15.55:0/1903873628 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f2840020100 con 0x7f284c0a0d80 2023-09-30T01:56:48.608 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:48.608 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:48.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.607+0000 7f284bfff700 10 mgrc shutdown 2023-09-30T01:56:48.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.607+0000 7f284bfff700 1 -- 172.21.15.55:0/1903873628 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f283808e8b0 msgr2=0x7f2838090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:48.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.607+0000 7f284bfff700 1 --2- 172.21.15.55:0/1903873628 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f283808e8b0 0x7f2838090d60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f284c13da30 tx=0x7f283c007c70 comp rx=0 tx=0).stop 2023-09-30T01:56:48.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.607+0000 7f284bfff700 1 -- 172.21.15.55:0/1903873628 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0a0d80 msgr2=0x7f284c099190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:48.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.607+0000 7f284bfff700 1 --2- 172.21.15.55:0/1903873628 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0a0d80 0x7f284c099190 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2840006fd0 tx=0x7f2840008040 comp rx=0 tx=0).stop 2023-09-30T01:56:48.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.607+0000 7f284bfff700 1 -- 172.21.15.55:0/1903873628 shutdown_connections 2023-09-30T01:56:48.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.607+0000 7f284bfff700 1 --2- 172.21.15.55:0/1903873628 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f284c13e6f0 0x7f284c099dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:48.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.607+0000 7f284bfff700 1 --2- 172.21.15.55:0/1903873628 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f284c0a1150 0x7f284c09b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:48.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.607+0000 7f284bfff700 1 --2- 172.21.15.55:0/1903873628 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f283808e8b0 0x7f2838090d60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:48.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.607+0000 7f284bfff700 1 --2- 172.21.15.55:0/1903873628 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f284c0a0d80 0x7f284c099190 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:48.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.607+0000 7f284bfff700 1 -- 172.21.15.55:0/1903873628 >> 172.21.15.55:0/1903873628 conn(0x7f284c0b23d0 msgr2=0x7f284c0a2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:48.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.607+0000 7f284bfff700 1 -- 172.21.15.55:0/1903873628 shutdown_connections 2023-09-30T01:56:48.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:48.607+0000 7f284bfff700 1 -- 172.21.15.55:0/1903873628 wait complete. 2023-09-30T01:56:51.623 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:51.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f2396ad7700 1 Processor -- start 2023-09-30T01:56:51.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f2396ad7700 1 -- start start 2023-09-30T01:56:51.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f2396ad7700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f23900a5450 0x7f23900a6990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:51.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f2396ad7700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23900a6f80 con 0x7f2390132770 2023-09-30T01:56:51.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f2396ad7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2390140280 con 0x7f239013f770 2023-09-30T01:56:51.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f2396ad7700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23900b3be0 con 0x7f23900a5450 2023-09-30T01:56:51.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f2395ad5700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f23900a5450 0x7f23900a6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:51.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f23952d4700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2390132770 0x7f239006d580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34206/0 (socket says 172.21.15.55:34206) 2023-09-30T01:56:51.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f23952d4700 1 -- 172.21.15.55:0/2770517782 learned_addr learned my addr 172.21.15.55:0/2770517782 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:56:51.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f2394ad3700 1 -- 172.21.15.55:0/2770517782 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3147749671 0 0) 0x7f23900a6f80 con 0x7f2390132770 2023-09-30T01:56:51.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f2394ad3700 1 -- 172.21.15.55:0/2770517782 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f237c003570 con 0x7f2390132770 2023-09-30T01:56:51.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f2395ad5700 1 -- 172.21.15.55:0/2770517782 >> v1:172.21.15.133:6789/0 conn(0x7f239013f770 legacy=0x7f2390146ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:51.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f2395ad5700 1 -- 172.21.15.55:0/2770517782 >> v1:172.21.15.55:6789/0 conn(0x7f2390132770 legacy=0x7f239006d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:51.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f2395ad5700 1 -- 172.21.15.55:0/2770517782 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2390140540 con 0x7f23900a5450 2023-09-30T01:56:51.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.735+0000 7f2395ad5700 1 --2- 172.21.15.55:0/2770517782 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f23900a5450 0x7f23900a6990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f238c009e90 tx=0x7f238c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9694780e005c440c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:51.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.739+0000 7f2394ad3700 1 -- 172.21.15.55:0/2770517782 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c00e070 con 0x7f23900a5450 2023-09-30T01:56:51.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.739+0000 7f2394ad3700 1 -- 172.21.15.55:0/2770517782 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c00bc30 con 0x7f23900a5450 2023-09-30T01:56:51.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.739+0000 7f2394ad3700 1 -- 172.21.15.55:0/2770517782 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c012430 con 0x7f23900a5450 2023-09-30T01:56:51.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.739+0000 7f2396ad7700 1 -- 172.21.15.55:0/2770517782 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f23900a5450 msgr2=0x7f23900a6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:51.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.739+0000 7f2396ad7700 1 --2- 172.21.15.55:0/2770517782 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f23900a5450 0x7f23900a6990 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f238c009e90 tx=0x7f238c009780 comp rx=0 tx=0).stop 2023-09-30T01:56:51.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.739+0000 7f2396ad7700 1 -- 172.21.15.55:0/2770517782 shutdown_connections 2023-09-30T01:56:51.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.739+0000 7f2396ad7700 1 --2- 172.21.15.55:0/2770517782 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f23900a5450 0x7f23900a6990 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:51.743 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.739+0000 7f2396ad7700 1 -- 172.21.15.55:0/2770517782 >> 172.21.15.55:0/2770517782 conn(0x7f23900b2c80 msgr2=0x7f23900b3080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:51.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.739+0000 7f2396ad7700 1 -- 172.21.15.55:0/2770517782 shutdown_connections 2023-09-30T01:56:51.744 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.739+0000 7f2396ad7700 1 -- 172.21.15.55:0/2770517782 wait complete. 2023-09-30T01:56:51.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2396ad7700 1 Processor -- start 2023-09-30T01:56:51.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2396ad7700 1 -- start start 2023-09-30T01:56:51.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2396ad7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23900a5450 0x7f239012d440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:51.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2396ad7700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2390132770 0x7f2390144310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:51.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2396ad7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f239013f770 0x7f239012e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:51.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2396ad7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239012de10 con 0x7f23900a5450 2023-09-30T01:56:51.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2396ad7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f239012eed0 con 0x7f239013f770 2023-09-30T01:56:51.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2396ad7700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f239012c280 con 0x7f2390132770 2023-09-30T01:56:51.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2395ad5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23900a5450 0x7f239012d440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:51.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f23952d4700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2390132770 0x7f2390144310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:51.747 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f23952d4700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2390132770 0x7f2390144310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:46210/0 (socket says 172.21.15.55:46210) 2023-09-30T01:56:51.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2395ad5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23900a5450 0x7f239012d440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:33956/0 (socket says 172.21.15.55:33956) 2023-09-30T01:56:51.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f23952d4700 1 -- 172.21.15.55:0/7559754 learned_addr learned my addr 172.21.15.55:0/7559754 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:51.748 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f23962d6700 1 --2- 172.21.15.55:0/7559754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f239013f770 0x7f239012e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:51.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f23952d4700 1 -- 172.21.15.55:0/7559754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f239013f770 msgr2=0x7f239012e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:51.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f23952d4700 1 --2- 172.21.15.55:0/7559754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f239013f770 0x7f239012e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:51.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f23952d4700 1 -- 172.21.15.55:0/7559754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23900a5450 msgr2=0x7f239012d440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:51.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f23952d4700 1 --2- 172.21.15.55:0/7559754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23900a5450 0x7f239012d440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:51.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f23952d4700 1 -- 172.21.15.55:0/7559754 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c009a20 con 0x7f2390132770 2023-09-30T01:56:51.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2395ad5700 1 --2- 172.21.15.55:0/7559754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23900a5450 0x7f239012d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:56:51.749 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f23952d4700 1 --2- 172.21.15.55:0/7559754 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2390132770 0x7f2390144310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f238000c7f0 tx=0x7f2380007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:51.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2385ffb700 1 -- 172.21.15.55:0/7559754 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380005b30 con 0x7f2390132770 2023-09-30T01:56:51.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2385ffb700 1 -- 172.21.15.55:0/7559754 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2380005cb0 con 0x7f2390132770 2023-09-30T01:56:51.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2396ad7700 1 -- 172.21.15.55:0/7559754 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23901448b0 con 0x7f2390132770 2023-09-30T01:56:51.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2385ffb700 1 -- 172.21.15.55:0/7559754 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380007320 con 0x7f2390132770 2023-09-30T01:56:51.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.743+0000 7f2396ad7700 1 -- 172.21.15.55:0/7559754 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f239012e780 con 0x7f2390132770 2023-09-30T01:56:51.750 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.747+0000 7f2396ad7700 1 -- 172.21.15.55:0/7559754 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239005ecb0 con 0x7f2390132770 2023-09-30T01:56:51.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.747+0000 7f2385ffb700 1 -- 172.21.15.55:0/7559754 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f238001b3b0 con 0x7f2390132770 2023-09-30T01:56:51.751 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.747+0000 7f2385ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:51.752 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.747+0000 7f2385ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:51.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.747+0000 7f2385ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:51.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.747+0000 7f2385ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:51.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.747+0000 7f2385ffb700 1 --2- 172.21.15.55:0/7559754 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f237408e8b0 0x7f2374090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:51.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.747+0000 7f2395ad5700 1 --2- 172.21.15.55:0/7559754 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f237408e8b0 0x7f2374090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:51.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.751+0000 7f2385ffb700 1 -- 172.21.15.55:0/7559754 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f23800b3c80 con 0x7f2390132770 2023-09-30T01:56:51.753 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.751+0000 7f2395ad5700 1 --2- 172.21.15.55:0/7559754 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f237408e8b0 0x7f2374090d60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f238c009e90 tx=0x7f238c019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:51.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.755+0000 7f2385ffb700 1 -- 172.21.15.55:0/7559754 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f23800846b0 con 0x7f2390132770 2023-09-30T01:56:51.957 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.951+0000 7f2396ad7700 1 -- 172.21.15.55:0/7559754 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f23900a44f0 con 0x7f2390132770 2023-09-30T01:56:51.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.955+0000 7f2385ffb700 1 -- 172.21.15.55:0/7559754 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f2380017080 con 0x7f2390132770 2023-09-30T01:56:51.958 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:51.958 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:51.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.959+0000 7f2396ad7700 10 mgrc shutdown 2023-09-30T01:56:51.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.959+0000 7f2396ad7700 1 -- 172.21.15.55:0/7559754 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f237408e8b0 msgr2=0x7f2374090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:51.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.959+0000 7f2396ad7700 1 --2- 172.21.15.55:0/7559754 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f237408e8b0 0x7f2374090d60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f238c009e90 tx=0x7f238c019000 comp rx=0 tx=0).stop 2023-09-30T01:56:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.959+0000 7f2396ad7700 1 -- 172.21.15.55:0/7559754 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2390132770 msgr2=0x7f2390144310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.959+0000 7f2396ad7700 1 --2- 172.21.15.55:0/7559754 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2390132770 0x7f2390144310 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f238000c7f0 tx=0x7f2380007e00 comp rx=0 tx=0).stop 2023-09-30T01:56:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.959+0000 7f2396ad7700 1 -- 172.21.15.55:0/7559754 shutdown_connections 2023-09-30T01:56:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.959+0000 7f2396ad7700 1 --2- 172.21.15.55:0/7559754 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f239013f770 0x7f239012e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.959+0000 7f2396ad7700 1 --2- 172.21.15.55:0/7559754 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f237408e8b0 0x7f2374090d60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.959+0000 7f2396ad7700 1 --2- 172.21.15.55:0/7559754 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2390132770 0x7f2390144310 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.959+0000 7f2396ad7700 1 --2- 172.21.15.55:0/7559754 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f23900a5450 0x7f239012d440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.959+0000 7f2396ad7700 1 -- 172.21.15.55:0/7559754 >> 172.21.15.55:0/7559754 conn(0x7f23900b2c80 msgr2=0x7f239013d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:51.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.959+0000 7f2396ad7700 1 -- 172.21.15.55:0/7559754 shutdown_connections 2023-09-30T01:56:51.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:51.959+0000 7f2396ad7700 1 -- 172.21.15.55:0/7559754 wait complete. 2023-09-30T01:56:54.979 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f99463b8700 1 Processor -- start 2023-09-30T01:56:55.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f99463b8700 1 -- start start 2023-09-30T01:56:55.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f99463b8700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9940141aa0 0x7f994006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:55.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f99463b8700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f994006e930 con 0x7f9940070150 2023-09-30T01:56:55.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f99463b8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9940070520 con 0x7f99400a8a00 2023-09-30T01:56:55.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f99463b8700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99400a7b80 con 0x7f9940141aa0 2023-09-30T01:56:55.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f9945bb7700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9940141aa0 0x7f994006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:55.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f9945bb7700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9940141aa0 0x7f994006e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55916/0 (socket says 172.21.15.55:55916) 2023-09-30T01:56:55.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f9945bb7700 1 -- 172.21.15.55:0/2641610005 learned_addr learned my addr 172.21.15.55:0/2641610005 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:55.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f99453b6700 1 --1- 172.21.15.55:0/2641610005 >> v1:172.21.15.55:6789/0 conn(0x7f9940070150 0x7f99400a82f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46110/0 (socket says 172.21.15.55:46110) 2023-09-30T01:56:55.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f9945bb7700 1 -- 172.21.15.55:0/2641610005 >> v1:172.21.15.133:6789/0 conn(0x7f99400a8a00 legacy=0x7f9940141390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:56:55.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f9945bb7700 1 -- 172.21.15.55:0/2641610005 >> v1:172.21.15.55:6789/0 conn(0x7f9940070150 legacy=0x7f99400a82f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:55.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f9945bb7700 1 -- 172.21.15.55:0/2641610005 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9940141110 con 0x7f9940141aa0 2023-09-30T01:56:55.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f9945bb7700 1 --2- 172.21.15.55:0/2641610005 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9940141aa0 0x7f994006e3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9938009f50 tx=0x7f9938009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1b4fecfd4b609772 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:55.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f9937fff700 1 -- 172.21.15.55:0/2641610005 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f993800e070 con 0x7f9940141aa0 2023-09-30T01:56:55.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f9937fff700 1 -- 172.21.15.55:0/2641610005 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f993800ba70 con 0x7f9940141aa0 2023-09-30T01:56:55.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f9937fff700 1 -- 172.21.15.55:0/2641610005 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99380092e0 con 0x7f9940141aa0 2023-09-30T01:56:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f99463b8700 1 -- 172.21.15.55:0/2641610005 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9940141aa0 msgr2=0x7f994006e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f99463b8700 1 --2- 172.21.15.55:0/2641610005 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9940141aa0 0x7f994006e3f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f9938009f50 tx=0x7f9938009840 comp rx=0 tx=0).stop 2023-09-30T01:56:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f99463b8700 1 -- 172.21.15.55:0/2641610005 shutdown_connections 2023-09-30T01:56:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f99463b8700 1 --2- 172.21.15.55:0/2641610005 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9940141aa0 0x7f994006e3f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:55.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f99463b8700 1 -- 172.21.15.55:0/2641610005 >> 172.21.15.55:0/2641610005 conn(0x7f994006a7b0 msgr2=0x7f99400a53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:55.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f99463b8700 1 -- 172.21.15.55:0/2641610005 shutdown_connections 2023-09-30T01:56:55.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.091+0000 7f99463b8700 1 -- 172.21.15.55:0/2641610005 wait complete. 2023-09-30T01:56:55.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.095+0000 7f99463b8700 1 Processor -- start 2023-09-30T01:56:55.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.095+0000 7f99463b8700 1 -- start start 2023-09-30T01:56:55.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.095+0000 7f99463b8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9940070150 0x7f994014dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:55.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.095+0000 7f99463b8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99400a8a00 0x7f99400a9240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:55.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.095+0000 7f99463b8700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9940141aa0 0x7f99400ae220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:55.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.095+0000 7f99463b8700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f994014e470 con 0x7f9940070150 2023-09-30T01:56:55.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.095+0000 7f99463b8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99400a98b0 con 0x7f99400a8a00 2023-09-30T01:56:55.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.095+0000 7f99463b8700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f994014d7d0 con 0x7f9940141aa0 2023-09-30T01:56:55.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.095+0000 7f99453b6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9940070150 0x7f994014dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:55.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.095+0000 7f99453b6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9940070150 0x7f994014dd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44894/0 (socket says 172.21.15.55:44894) 2023-09-30T01:56:55.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f99453b6700 1 -- 172.21.15.55:0/2975542849 learned_addr learned my addr 172.21.15.55:0/2975542849 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:55.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f9945bb7700 1 --2- 172.21.15.55:0/2975542849 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9940141aa0 0x7f99400ae220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:55.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f9944bb5700 1 --2- 172.21.15.55:0/2975542849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99400a8a00 0x7f99400a9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f99453b6700 1 -- 172.21.15.55:0/2975542849 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9940141aa0 msgr2=0x7f99400ae220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f99453b6700 1 --2- 172.21.15.55:0/2975542849 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9940141aa0 0x7f99400ae220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f99453b6700 1 -- 172.21.15.55:0/2975542849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99400a8a00 msgr2=0x7f99400a9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f99453b6700 1 --2- 172.21.15.55:0/2975542849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99400a8a00 0x7f99400a9240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f99453b6700 1 -- 172.21.15.55:0/2975542849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9938009ae0 con 0x7f9940070150 2023-09-30T01:56:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f99453b6700 1 --2- 172.21.15.55:0/2975542849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9940070150 0x7f994014dd70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f993000c7c0 tx=0x7f9930007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f99357fa700 1 -- 172.21.15.55:0/2975542849 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9930005a70 con 0x7f9940070150 2023-09-30T01:56:55.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f99357fa700 1 -- 172.21.15.55:0/2975542849 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9930005bd0 con 0x7f9940070150 2023-09-30T01:56:55.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f99463b8700 1 -- 172.21.15.55:0/2975542849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99400aac60 con 0x7f9940070150 2023-09-30T01:56:55.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f99357fa700 1 -- 172.21.15.55:0/2975542849 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99300070d0 con 0x7f9940070150 2023-09-30T01:56:55.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f99463b8700 1 -- 172.21.15.55:0/2975542849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99400ae900 con 0x7f9940070150 2023-09-30T01:56:55.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.099+0000 7f99463b8700 1 -- 172.21.15.55:0/2975542849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9940064440 con 0x7f9940070150 2023-09-30T01:56:55.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.103+0000 7f99357fa700 1 -- 172.21.15.55:0/2975542849 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f9930007440 con 0x7f9940070150 2023-09-30T01:56:55.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.103+0000 7f99357fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:55.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.103+0000 7f99357fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:55.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.103+0000 7f99357fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:55.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.103+0000 7f99357fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:55.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.103+0000 7f99357fa700 1 --2- 172.21.15.55:0/2975542849 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f992408e8b0 0x7f9924090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:55.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.103+0000 7f9944bb5700 1 --2- 172.21.15.55:0/2975542849 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f992408e8b0 0x7f9924090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:55.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.103+0000 7f99357fa700 1 -- 172.21.15.55:0/2975542849 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f99300b3f10 con 0x7f9940070150 2023-09-30T01:56:55.108 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.103+0000 7f9944bb5700 1 --2- 172.21.15.55:0/2975542849 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f992408e8b0 0x7f9924090d60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f99401414d0 tx=0x7f993c007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:55.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.107+0000 7f99357fa700 1 -- 172.21.15.55:0/2975542849 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f99300848a0 con 0x7f9940070150 2023-09-30T01:56:55.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.299+0000 7f99463b8700 1 -- 172.21.15.55:0/2975542849 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f994006e930 con 0x7f9940070150 2023-09-30T01:56:55.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.303+0000 7f99357fa700 1 -- 172.21.15.55:0/2975542849 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f994006e930 con 0x7f9940070150 2023-09-30T01:56:55.305 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:55.306 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:55.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.303+0000 7f99463b8700 10 mgrc shutdown 2023-09-30T01:56:55.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.303+0000 7f99463b8700 1 -- 172.21.15.55:0/2975542849 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f992408e8b0 msgr2=0x7f9924090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:55.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.303+0000 7f99463b8700 1 --2- 172.21.15.55:0/2975542849 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f992408e8b0 0x7f9924090d60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f99401414d0 tx=0x7f993c007ea0 comp rx=0 tx=0).stop 2023-09-30T01:56:55.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.303+0000 7f99463b8700 1 -- 172.21.15.55:0/2975542849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9940070150 msgr2=0x7f994014dd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:55.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.303+0000 7f99463b8700 1 --2- 172.21.15.55:0/2975542849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9940070150 0x7f994014dd70 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f993000c7c0 tx=0x7f9930007f30 comp rx=0 tx=0).stop 2023-09-30T01:56:55.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.303+0000 7f99463b8700 1 -- 172.21.15.55:0/2975542849 shutdown_connections 2023-09-30T01:56:55.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.303+0000 7f99463b8700 1 --2- 172.21.15.55:0/2975542849 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f992408e8b0 0x7f9924090d60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.303+0000 7f99463b8700 1 --2- 172.21.15.55:0/2975542849 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9940141aa0 0x7f99400ae220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.303+0000 7f99463b8700 1 --2- 172.21.15.55:0/2975542849 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f99400a8a00 0x7f99400a9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.303+0000 7f99463b8700 1 --2- 172.21.15.55:0/2975542849 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9940070150 0x7f994014dd70 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.303+0000 7f99463b8700 1 -- 172.21.15.55:0/2975542849 >> 172.21.15.55:0/2975542849 conn(0x7f994006a7b0 msgr2=0x7f994013fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.303+0000 7f99463b8700 1 -- 172.21.15.55:0/2975542849 shutdown_connections 2023-09-30T01:56:55.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:55.303+0000 7f99463b8700 1 -- 172.21.15.55:0/2975542849 wait complete. 2023-09-30T01:56:58.320 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:56:58.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7afb598700 1 Processor -- start 2023-09-30T01:56:58.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7afb598700 1 -- start start 2023-09-30T01:56:58.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7afb598700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7af4149a40 0x7f7af414be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:58.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7afb598700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af40a48b0 con 0x7f7af40a55c0 2023-09-30T01:56:58.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7afb598700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7af40676a0 con 0x7f7af40672d0 2023-09-30T01:56:58.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7afb598700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af40a3780 con 0x7f7af4149a40 2023-09-30T01:56:58.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7afad97700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7af4149a40 0x7f7af414be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:58.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7afad97700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7af4149a40 0x7f7af414be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55936/0 (socket says 172.21.15.55:55936) 2023-09-30T01:56:58.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7af9d95700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7af40a55c0 0x7f7af40a8890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46114/0 (socket says 172.21.15.55:46114) 2023-09-30T01:56:58.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7afad97700 1 -- 172.21.15.55:0/781459764 learned_addr learned my addr 172.21.15.55:0/781459764 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:58.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7afad97700 1 -- 172.21.15.55:0/781459764 >> v1:172.21.15.133:6789/0 conn(0x7f7af40672d0 legacy=0x7f7af413f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:58.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7afad97700 1 -- 172.21.15.55:0/781459764 >> v1:172.21.15.55:6789/0 conn(0x7f7af40a55c0 legacy=0x7f7af40a8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:58.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7afad97700 1 -- 172.21.15.55:0/781459764 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7af40a3970 con 0x7f7af4149a40 2023-09-30T01:56:58.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7afad97700 1 --2- 172.21.15.55:0/781459764 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7af4149a40 0x7f7af414be20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40099e0 tx=0x7f7ae4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aeeffd926024047b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:58.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7af9594700 1 -- 172.21.15.55:0/781459764 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae400b860 con 0x7f7af4149a40 2023-09-30T01:56:58.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7af9594700 1 -- 172.21.15.55:0/781459764 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae400b9c0 con 0x7f7af4149a40 2023-09-30T01:56:58.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.435+0000 7f7af9594700 1 -- 172.21.15.55:0/781459764 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae400bd60 con 0x7f7af4149a40 2023-09-30T01:56:58.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 -- 172.21.15.55:0/781459764 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7af4149a40 msgr2=0x7f7af414be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:58.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 --2- 172.21.15.55:0/781459764 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7af4149a40 0x7f7af414be20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ae40099e0 tx=0x7f7ae4009250 comp rx=0 tx=0).stop 2023-09-30T01:56:58.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 -- 172.21.15.55:0/781459764 shutdown_connections 2023-09-30T01:56:58.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 --2- 172.21.15.55:0/781459764 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7af4149a40 0x7f7af414be20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:58.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 -- 172.21.15.55:0/781459764 >> 172.21.15.55:0/781459764 conn(0x7f7af40635c0 msgr2=0x7f7af406ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:58.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 -- 172.21.15.55:0/781459764 shutdown_connections 2023-09-30T01:56:58.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 -- 172.21.15.55:0/781459764 wait complete. 2023-09-30T01:56:58.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 Processor -- start 2023-09-30T01:56:58.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 -- start start 2023-09-30T01:56:58.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7af40672d0 0x7f7af406c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:58.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7af40a55c0 0x7f7af4139300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:58.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7af4149a40 0x7f7af406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:58.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af406d080 con 0x7f7af40a55c0 2023-09-30T01:56:58.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7af4139ca0 con 0x7f7af40672d0 2023-09-30T01:56:58.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afb598700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7af406d2c0 con 0x7f7af4149a40 2023-09-30T01:56:58.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afad97700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7af4149a40 0x7f7af406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:58.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7af9d95700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7af40a55c0 0x7f7af4139300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:58.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afad97700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7af4149a40 0x7f7af406cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:55942/0 (socket says 172.21.15.55:55942) 2023-09-30T01:56:58.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afad97700 1 -- 172.21.15.55:0/437273652 learned_addr learned my addr 172.21.15.55:0/437273652 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:56:58.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.439+0000 7f7afa596700 1 --2- 172.21.15.55:0/437273652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7af40672d0 0x7f7af406c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:58.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.443+0000 7f7afad97700 1 -- 172.21.15.55:0/437273652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7af40672d0 msgr2=0x7f7af406c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:58.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.443+0000 7f7afad97700 1 --2- 172.21.15.55:0/437273652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7af40672d0 0x7f7af406c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:58.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.443+0000 7f7afad97700 1 -- 172.21.15.55:0/437273652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7af40a55c0 msgr2=0x7f7af4139300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:58.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.443+0000 7f7afad97700 1 --2- 172.21.15.55:0/437273652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7af40a55c0 0x7f7af4139300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:58.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.443+0000 7f7afad97700 1 -- 172.21.15.55:0/437273652 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ae40094f0 con 0x7f7af4149a40 2023-09-30T01:56:58.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.443+0000 7f7afad97700 1 --2- 172.21.15.55:0/437273652 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7af4149a40 0x7f7af406cb40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009290 tx=0x7f7ae4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:58.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.443+0000 7f7af27fc700 1 -- 172.21.15.55:0/437273652 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae400b860 con 0x7f7af4149a40 2023-09-30T01:56:58.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.443+0000 7f7af27fc700 1 -- 172.21.15.55:0/437273652 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ae401a660 con 0x7f7af4149a40 2023-09-30T01:56:58.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.443+0000 7f7afb598700 1 -- 172.21.15.55:0/437273652 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7af406d560 con 0x7f7af4149a40 2023-09-30T01:56:58.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.443+0000 7f7af27fc700 1 -- 172.21.15.55:0/437273652 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ae401aa20 con 0x7f7af4149a40 2023-09-30T01:56:58.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.443+0000 7f7afb598700 1 -- 172.21.15.55:0/437273652 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7af406bc90 con 0x7f7af4149a40 2023-09-30T01:56:58.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.447+0000 7f7afb598700 1 -- 172.21.15.55:0/437273652 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7af4064440 con 0x7f7af4149a40 2023-09-30T01:56:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.447+0000 7f7af27fc700 1 -- 172.21.15.55:0/437273652 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f7ae401b430 con 0x7f7af4149a40 2023-09-30T01:56:58.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.447+0000 7f7af27fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:56:58.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.447+0000 7f7af27fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:56:58.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.447+0000 7f7af27fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:58.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.447+0000 7f7af27fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:56:58.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.447+0000 7f7af27fc700 1 --2- 172.21.15.55:0/437273652 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7ae008e8b0 0x7f7ae0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:56:58.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.447+0000 7f7afa596700 1 --2- 172.21.15.55:0/437273652 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7ae008e8b0 0x7f7ae0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:56:58.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.451+0000 7f7afa596700 1 --2- 172.21.15.55:0/437273652 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7ae008e8b0 0x7f7ae0090d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7aec007fd0 tx=0x7f7aec0016f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:56:58.454 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.451+0000 7f7af27fc700 1 -- 172.21.15.55:0/437273652 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f7ae408b230 con 0x7f7af4149a40 2023-09-30T01:56:58.461 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.459+0000 7f7af27fc700 1 -- 172.21.15.55:0/437273652 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7ae4086e30 con 0x7f7af4149a40 2023-09-30T01:56:58.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.647+0000 7f7afb598700 1 -- 172.21.15.55:0/437273652 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7af40a3c10 con 0x7f7af4149a40 2023-09-30T01:56:58.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.647+0000 7f7af27fc700 1 -- 172.21.15.55:0/437273652 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f7ae408a450 con 0x7f7af4149a40 2023-09-30T01:56:58.653 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:56:58.653 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:56:58.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.651+0000 7f7afb598700 10 mgrc shutdown 2023-09-30T01:56:58.657 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.651+0000 7f7afb598700 1 -- 172.21.15.55:0/437273652 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7ae008e8b0 msgr2=0x7f7ae0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.651+0000 7f7afb598700 1 --2- 172.21.15.55:0/437273652 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7ae008e8b0 0x7f7ae0090d60 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f7aec007fd0 tx=0x7f7aec0016f0 comp rx=0 tx=0).stop 2023-09-30T01:56:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.651+0000 7f7afb598700 1 -- 172.21.15.55:0/437273652 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7af4149a40 msgr2=0x7f7af406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:56:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.651+0000 7f7afb598700 1 --2- 172.21.15.55:0/437273652 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7af4149a40 0x7f7af406cb40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7ae4009290 tx=0x7f7ae4017000 comp rx=0 tx=0).stop 2023-09-30T01:56:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.651+0000 7f7afb598700 1 -- 172.21.15.55:0/437273652 shutdown_connections 2023-09-30T01:56:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.651+0000 7f7afb598700 1 --2- 172.21.15.55:0/437273652 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7ae008e8b0 0x7f7ae0090d60 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.651+0000 7f7afb598700 1 --2- 172.21.15.55:0/437273652 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7af4149a40 0x7f7af406cb40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.651+0000 7f7afb598700 1 --2- 172.21.15.55:0/437273652 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7af40a55c0 0x7f7af4139300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.651+0000 7f7afb598700 1 --2- 172.21.15.55:0/437273652 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7af40672d0 0x7f7af406c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:56:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.651+0000 7f7afb598700 1 -- 172.21.15.55:0/437273652 >> 172.21.15.55:0/437273652 conn(0x7f7af40635c0 msgr2=0x7f7af40a87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:56:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.651+0000 7f7afb598700 1 -- 172.21.15.55:0/437273652 shutdown_connections 2023-09-30T01:56:58.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:56:58.651+0000 7f7afb598700 1 -- 172.21.15.55:0/437273652 wait complete. 2023-09-30T01:57:01.672 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:01.784 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.779+0000 7f8010d5f700 1 Processor -- start 2023-09-30T01:57:01.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.779+0000 7f8010d5f700 1 -- start start 2023-09-30T01:57:01.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f800c06af90 0x7f800c13d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:01.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f800c13d5a0 0x7f800c1473c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:01.785 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800c0a1880 con 0x7f800c0a4bc0 2023-09-30T01:57:01.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c0a4f90 con 0x7f800c13d5a0 2023-09-30T01:57:01.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800c06b360 con 0x7f800c06af90 2023-09-30T01:57:01.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f800b7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f800c0a4bc0 0x7f800c06c360 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60532/0 (socket says 172.21.15.55:60532) 2023-09-30T01:57:01.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f800b7fe700 1 -- 172.21.15.55:0/173962327 learned_addr learned my addr 172.21.15.55:0/173962327 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:57:01.786 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f800bfff700 1 --2- 172.21.15.55:0/173962327 >> v2:172.21.15.55:3300/0 conn(0x7f800c13d5a0 0x7f800c1473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:01.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8002ffd700 1 --2- 172.21.15.55:0/173962327 >> v2:172.21.15.133:3300/0 conn(0x7f800c06af90 0x7f800c13d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f800affd700 1 -- 172.21.15.55:0/173962327 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 275566931 0 0) 0x7f800c0a1880 con 0x7f800c0a4bc0 2023-09-30T01:57:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f800bfff700 1 -- 172.21.15.55:0/173962327 >> v2:172.21.15.133:3300/0 conn(0x7f800c06af90 msgr2=0x7f800c13d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:57:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f800bfff700 1 --2- 172.21.15.55:0/173962327 >> v2:172.21.15.133:3300/0 conn(0x7f800c06af90 0x7f800c13d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f800bfff700 1 -- 172.21.15.55:0/173962327 >> v1:172.21.15.55:6789/0 conn(0x7f800c0a4bc0 legacy=0x7f800c06c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f800bfff700 1 -- 172.21.15.55:0/173962327 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c0a1ab0 con 0x7f800c13d5a0 2023-09-30T01:57:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f800bfff700 1 --2- 172.21.15.55:0/173962327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f800c13d5a0 0x7f800c1473c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f800c0a1ca0 tx=0x7f8004009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab7b4613a696c56 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f800affd700 1 -- 172.21.15.55:0/173962327 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8004016070 con 0x7f800c13d5a0 2023-09-30T01:57:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f800affd700 1 -- 172.21.15.55:0/173962327 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f800400bc00 con 0x7f800c13d5a0 2023-09-30T01:57:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f800affd700 1 -- 172.21.15.55:0/173962327 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f800400e070 con 0x7f800c13d5a0 2023-09-30T01:57:01.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 -- 172.21.15.55:0/173962327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f800c13d5a0 msgr2=0x7f800c1473c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:01.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 --2- 172.21.15.55:0/173962327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f800c13d5a0 0x7f800c1473c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f800c0a1ca0 tx=0x7f8004009780 comp rx=0 tx=0).stop 2023-09-30T01:57:01.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 -- 172.21.15.55:0/173962327 shutdown_connections 2023-09-30T01:57:01.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 --2- 172.21.15.55:0/173962327 >> v2:172.21.15.133:3300/0 conn(0x7f800c06af90 0x7f800c13d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:01.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 --2- 172.21.15.55:0/173962327 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f800c13d5a0 0x7f800c1473c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:01.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 -- 172.21.15.55:0/173962327 >> 172.21.15.55:0/173962327 conn(0x7f800c0b23d0 msgr2=0x7f800c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:01.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 -- 172.21.15.55:0/173962327 shutdown_connections 2023-09-30T01:57:01.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 -- 172.21.15.55:0/173962327 wait complete. 2023-09-30T01:57:01.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 Processor -- start 2023-09-30T01:57:01.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.783+0000 7f8010d5f700 1 -- start start 2023-09-30T01:57:01.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8010d5f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f800c06af90 0x7f800c09e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:01.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8010d5f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f800c0a4bc0 0x7f800c146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:01.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8010d5f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f800c13d5a0 0x7f800c141710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:01.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8010d5f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c143470 con 0x7f800c0a4bc0 2023-09-30T01:57:01.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8010d5f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c146790 con 0x7f800c06af90 2023-09-30T01:57:01.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8010d5f700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c1436a0 con 0x7f800c13d5a0 2023-09-30T01:57:01.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8002ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f800c0a4bc0 0x7f800c146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:01.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f800bfff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f800c13d5a0 0x7f800c141710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:01.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8002ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f800c0a4bc0 0x7f800c146250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43774/0 (socket says 172.21.15.55:43774) 2023-09-30T01:57:01.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8002ffd700 1 -- 172.21.15.55:0/639765291 learned_addr learned my addr 172.21.15.55:0/639765291 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:01.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f800b7fe700 1 --2- 172.21.15.55:0/639765291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f800c06af90 0x7f800c09e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:01.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8002ffd700 1 -- 172.21.15.55:0/639765291 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f800c13d5a0 msgr2=0x7f800c141710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:01.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8002ffd700 1 --2- 172.21.15.55:0/639765291 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f800c13d5a0 0x7f800c141710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:01.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8002ffd700 1 -- 172.21.15.55:0/639765291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f800c06af90 msgr2=0x7f800c09e5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:01.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8002ffd700 1 --2- 172.21.15.55:0/639765291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f800c06af90 0x7f800c09e5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:01.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8002ffd700 1 -- 172.21.15.55:0/639765291 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8004009a20 con 0x7f800c0a4bc0 2023-09-30T01:57:01.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8002ffd700 1 --2- 172.21.15.55:0/639765291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f800c0a4bc0 0x7f800c146250 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400d860 tx=0x7f7ff4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:01.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8003fff700 1 -- 172.21.15.55:0/639765291 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff40125f0 con 0x7f800c0a4bc0 2023-09-30T01:57:01.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8003fff700 1 -- 172.21.15.55:0/639765291 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff4012750 con 0x7f800c0a4bc0 2023-09-30T01:57:01.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8010d5f700 1 -- 172.21.15.55:0/639765291 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f800c1427c0 con 0x7f800c0a4bc0 2023-09-30T01:57:01.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8003fff700 1 -- 172.21.15.55:0/639765291 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4012b10 con 0x7f800c0a4bc0 2023-09-30T01:57:01.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8010d5f700 1 -- 172.21.15.55:0/639765291 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f800c141df0 con 0x7f800c0a4bc0 2023-09-30T01:57:01.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.787+0000 7f8010d5f700 1 -- 172.21.15.55:0/639765291 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f800c1420d0 con 0x7f800c0a4bc0 2023-09-30T01:57:01.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.791+0000 7f8003fff700 1 -- 172.21.15.55:0/639765291 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f7ff401e460 con 0x7f800c0a4bc0 2023-09-30T01:57:01.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.791+0000 7f8003fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:01.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.791+0000 7f8003fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:01.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.791+0000 7f8003fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:01.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.791+0000 7f8003fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:01.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.791+0000 7f8003fff700 1 --2- 172.21.15.55:0/639765291 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7fec08e8b0 0x7f7fec090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:01.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.795+0000 7f800b7fe700 1 --2- 172.21.15.55:0/639765291 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7fec08e8b0 0x7f7fec090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:01.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.795+0000 7f8003fff700 1 -- 172.21.15.55:0/639765291 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f7ff40b5870 con 0x7f800c0a4bc0 2023-09-30T01:57:01.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.795+0000 7f800b7fe700 1 --2- 172.21.15.55:0/639765291 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7fec08e8b0 0x7f7fec090d60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc007fd0 tx=0x7f7ffc007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:01.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.799+0000 7f8003fff700 1 -- 172.21.15.55:0/639765291 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7ff4089d10 con 0x7f800c0a4bc0 2023-09-30T01:57:01.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8010d5f700 1 -- 172.21.15.55:0/639765291 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f800c064440 con 0x7f800c0a4bc0 2023-09-30T01:57:01.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8003fff700 1 -- 172.21.15.55:0/639765291 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f7ff40898a0 con 0x7f800c0a4bc0 2023-09-30T01:57:01.998 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:01.998 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:02.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8010d5f700 10 mgrc shutdown 2023-09-30T01:57:02.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8010d5f700 1 -- 172.21.15.55:0/639765291 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7fec08e8b0 msgr2=0x7f7fec090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:02.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8010d5f700 1 --2- 172.21.15.55:0/639765291 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7fec08e8b0 0x7f7fec090d60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc007fd0 tx=0x7f7ffc007d30 comp rx=0 tx=0).stop 2023-09-30T01:57:02.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8010d5f700 1 -- 172.21.15.55:0/639765291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f800c0a4bc0 msgr2=0x7f800c146250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:02.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8010d5f700 1 --2- 172.21.15.55:0/639765291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f800c0a4bc0 0x7f800c146250 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f7ff400d860 tx=0x7f7ff4008040 comp rx=0 tx=0).stop 2023-09-30T01:57:02.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8010d5f700 1 -- 172.21.15.55:0/639765291 shutdown_connections 2023-09-30T01:57:02.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8010d5f700 1 --2- 172.21.15.55:0/639765291 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7fec08e8b0 0x7f7fec090d60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:02.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8010d5f700 1 --2- 172.21.15.55:0/639765291 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f800c13d5a0 0x7f800c141710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:02.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8010d5f700 1 --2- 172.21.15.55:0/639765291 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f800c0a4bc0 0x7f800c146250 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:02.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8010d5f700 1 --2- 172.21.15.55:0/639765291 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f800c06af90 0x7f800c09e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:02.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8010d5f700 1 -- 172.21.15.55:0/639765291 >> 172.21.15.55:0/639765291 conn(0x7f800c0b23d0 msgr2=0x7f800c13b910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:02.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8010d5f700 1 -- 172.21.15.55:0/639765291 shutdown_connections 2023-09-30T01:57:02.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:01.995+0000 7f8010d5f700 1 -- 172.21.15.55:0/639765291 wait complete. 2023-09-30T01:57:05.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:05.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.123+0000 7f95ebfff700 1 Processor -- start 2023-09-30T01:57:05.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.123+0000 7f95ebfff700 1 -- start start 2023-09-30T01:57:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f95ec0b1630 0x7f95ec0a67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95ec13d610 0x7f95ec0a4f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95ec06e190 con 0x7f95ec0a5480 2023-09-30T01:57:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95ec0b1a00 con 0x7f95ec0b1630 2023-09-30T01:57:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0a6d30 con 0x7f95ec13d610 2023-09-30T01:57:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95e3fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95ec13d610 0x7f95ec0a4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95eb7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f95ec0a5480 0x7f95ec0670a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60534/0 (socket says 172.21.15.55:60534) 2023-09-30T01:57:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95eb7fe700 1 -- 172.21.15.55:0/4003604488 learned_addr learned my addr 172.21.15.55:0/4003604488 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:57:05.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95eaffd700 1 --2- 172.21.15.55:0/4003604488 >> v2:172.21.15.133:3300/0 conn(0x7f95ec0b1630 0x7f95ec0a67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:05.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95e3fff700 1 -- 172.21.15.55:0/4003604488 >> v2:172.21.15.133:3300/0 conn(0x7f95ec0b1630 msgr2=0x7f95ec0a67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:57:05.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95e3fff700 1 --2- 172.21.15.55:0/4003604488 >> v2:172.21.15.133:3300/0 conn(0x7f95ec0b1630 0x7f95ec0a67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:05.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ea7fc700 1 -- 172.21.15.55:0/4003604488 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632776351 0 0) 0x7f95ec06e190 con 0x7f95ec0a5480 2023-09-30T01:57:05.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95e3fff700 1 -- 172.21.15.55:0/4003604488 >> v1:172.21.15.55:6789/0 conn(0x7f95ec0a5480 legacy=0x7f95ec0670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:05.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95e3fff700 1 -- 172.21.15.55:0/4003604488 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ec1417f0 con 0x7f95ec13d610 2023-09-30T01:57:05.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95e3fff700 1 --2- 172.21.15.55:0/4003604488 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95ec13d610 0x7f95ec0a4f40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f95d40098e0 tx=0x7f95d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da236ee1afff2393 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:05.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ea7fc700 1 -- 172.21.15.55:0/4003604488 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d400b640 con 0x7f95ec13d610 2023-09-30T01:57:05.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ea7fc700 1 -- 172.21.15.55:0/4003604488 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95d400b7a0 con 0x7f95ec13d610 2023-09-30T01:57:05.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ea7fc700 1 -- 172.21.15.55:0/4003604488 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95d400bb40 con 0x7f95ec13d610 2023-09-30T01:57:05.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 -- 172.21.15.55:0/4003604488 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95ec13d610 msgr2=0x7f95ec0a4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 --2- 172.21.15.55:0/4003604488 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95ec13d610 0x7f95ec0a4f40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f95d40098e0 tx=0x7f95d40091a0 comp rx=0 tx=0).stop 2023-09-30T01:57:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 -- 172.21.15.55:0/4003604488 shutdown_connections 2023-09-30T01:57:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 --2- 172.21.15.55:0/4003604488 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95ec13d610 0x7f95ec0a4f40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 --2- 172.21.15.55:0/4003604488 >> v2:172.21.15.133:3300/0 conn(0x7f95ec0b1630 0x7f95ec0a67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 -- 172.21.15.55:0/4003604488 >> 172.21.15.55:0/4003604488 conn(0x7f95ec068770 msgr2=0x7f95ec068b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 -- 172.21.15.55:0/4003604488 shutdown_connections 2023-09-30T01:57:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 -- 172.21.15.55:0/4003604488 wait complete. 2023-09-30T01:57:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 Processor -- start 2023-09-30T01:57:05.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.127+0000 7f95ebfff700 1 -- start start 2023-09-30T01:57:05.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95ebfff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95ec0a5480 0x7f95ec0a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:05.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95ebfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95ec0b1630 0x7f95ec13a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:05.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95ebfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95ec13d610 0x7f95ec150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:05.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95ebfff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec1516b0 con 0x7f95ec13d610 2023-09-30T01:57:05.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95ebfff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec151970 con 0x7f95ec0b1630 2023-09-30T01:57:05.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95ebfff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec0a7280 con 0x7f95ec0a5480 2023-09-30T01:57:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95eb7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95ec13d610 0x7f95ec150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95eaffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95ec0a5480 0x7f95ec0a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95eb7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95ec13d610 0x7f95ec150fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43784/0 (socket says 172.21.15.55:43784) 2023-09-30T01:57:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95eb7fe700 1 -- 172.21.15.55:0/159557509 learned_addr learned my addr 172.21.15.55:0/159557509 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95e3fff700 1 --2- 172.21.15.55:0/159557509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95ec0b1630 0x7f95ec13a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95eb7fe700 1 -- 172.21.15.55:0/159557509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95ec0a5480 msgr2=0x7f95ec0a8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95eb7fe700 1 --2- 172.21.15.55:0/159557509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95ec0a5480 0x7f95ec0a8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95eb7fe700 1 -- 172.21.15.55:0/159557509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95ec0b1630 msgr2=0x7f95ec13a890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:05.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95eb7fe700 1 --2- 172.21.15.55:0/159557509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95ec0b1630 0x7f95ec13a890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:05.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95eb7fe700 1 -- 172.21.15.55:0/159557509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95d4009420 con 0x7f95ec13d610 2023-09-30T01:57:05.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95eb7fe700 1 --2- 172.21.15.55:0/159557509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95ec13d610 0x7f95ec150fa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f95e400ccc0 tx=0x7f95e4001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:05.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95e2ffd700 1 -- 172.21.15.55:0/159557509 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400a930 con 0x7f95ec13d610 2023-09-30T01:57:05.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95e2ffd700 1 -- 172.21.15.55:0/159557509 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95e400aa90 con 0x7f95ec13d610 2023-09-30T01:57:05.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95ebfff700 1 -- 172.21.15.55:0/159557509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ec0a7a30 con 0x7f95ec13d610 2023-09-30T01:57:05.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95e2ffd700 1 -- 172.21.15.55:0/159557509 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95e400ae30 con 0x7f95ec13d610 2023-09-30T01:57:05.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95ebfff700 1 -- 172.21.15.55:0/159557509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ec0a8850 con 0x7f95ec13d610 2023-09-30T01:57:05.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.131+0000 7f95ebfff700 1 -- 172.21.15.55:0/159557509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ec0a8c00 con 0x7f95ec13d610 2023-09-30T01:57:05.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.135+0000 7f95e2ffd700 1 -- 172.21.15.55:0/159557509 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f95e4007300 con 0x7f95ec13d610 2023-09-30T01:57:05.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.135+0000 7f95e2ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:05.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.135+0000 7f95e2ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:05.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.135+0000 7f95e2ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:05.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.135+0000 7f95e2ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:05.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.135+0000 7f95e2ffd700 1 --2- 172.21.15.55:0/159557509 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f95cc08e8b0 0x7f95cc090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:05.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.135+0000 7f95eaffd700 1 --2- 172.21.15.55:0/159557509 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f95cc08e8b0 0x7f95cc090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:05.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.135+0000 7f95e2ffd700 1 -- 172.21.15.55:0/159557509 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f95e40b4d00 con 0x7f95ec13d610 2023-09-30T01:57:05.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.135+0000 7f95eaffd700 1 --2- 172.21.15.55:0/159557509 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f95cc08e8b0 0x7f95cc090d60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009db0 tx=0x7f95dc0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:05.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.143+0000 7f95e2ffd700 1 -- 172.21.15.55:0/159557509 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f95ec0a8c00 con 0x7f95ec13d610 2023-09-30T01:57:05.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.335+0000 7f95ebfff700 1 -- 172.21.15.55:0/159557509 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f95ec0a8c00 con 0x7f95ec13d610 2023-09-30T01:57:05.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.335+0000 7f95e2ffd700 1 -- 172.21.15.55:0/159557509 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f95ec0a8c00 con 0x7f95ec13d610 2023-09-30T01:57:05.341 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:05.341 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:05.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.339+0000 7f95ebfff700 10 mgrc shutdown 2023-09-30T01:57:05.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.339+0000 7f95ebfff700 1 -- 172.21.15.55:0/159557509 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f95cc08e8b0 msgr2=0x7f95cc090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:05.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.339+0000 7f95ebfff700 1 --2- 172.21.15.55:0/159557509 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f95cc08e8b0 0x7f95cc090d60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f95dc009db0 tx=0x7f95dc0091a0 comp rx=0 tx=0).stop 2023-09-30T01:57:05.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.339+0000 7f95ebfff700 1 -- 172.21.15.55:0/159557509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95ec13d610 msgr2=0x7f95ec150fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:05.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.339+0000 7f95ebfff700 1 --2- 172.21.15.55:0/159557509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95ec13d610 0x7f95ec150fa0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f95e400ccc0 tx=0x7f95e4001a20 comp rx=0 tx=0).stop 2023-09-30T01:57:05.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.339+0000 7f95ebfff700 1 -- 172.21.15.55:0/159557509 shutdown_connections 2023-09-30T01:57:05.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.339+0000 7f95ebfff700 1 --2- 172.21.15.55:0/159557509 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f95ec13d610 0x7f95ec150fa0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:05.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.339+0000 7f95ebfff700 1 --2- 172.21.15.55:0/159557509 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f95ec0b1630 0x7f95ec13a890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:05.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.339+0000 7f95ebfff700 1 --2- 172.21.15.55:0/159557509 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f95cc08e8b0 0x7f95cc090d60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:05.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.339+0000 7f95ebfff700 1 --2- 172.21.15.55:0/159557509 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f95ec0a5480 0x7f95ec0a8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:05.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.339+0000 7f95ebfff700 1 -- 172.21.15.55:0/159557509 >> 172.21.15.55:0/159557509 conn(0x7f95ec068770 msgr2=0x7f95ec13c880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:05.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.339+0000 7f95ebfff700 1 -- 172.21.15.55:0/159557509 shutdown_connections 2023-09-30T01:57:05.345 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:05.339+0000 7f95ebfff700 1 -- 172.21.15.55:0/159557509 wait complete. 2023-09-30T01:57:08.355 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:08.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8d5cb4700 1 Processor -- start 2023-09-30T01:57:08.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8d5cb4700 1 -- start start 2023-09-30T01:57:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8d5cb4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa8d013e5f0 0x7fa8d013ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8d5cb4700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8d00a7810 0x7fa8d00a7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8d5cb4700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8d00b3430 con 0x7fa8d00b3060 2023-09-30T01:57:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8d5cb4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8d013b8f0 con 0x7fa8d013e5f0 2023-09-30T01:57:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8d5cb4700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00a6830 con 0x7fa8d00a7810 2023-09-30T01:57:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8cffff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8d00a7810 0x7fa8d00a7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8cffff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8d00a7810 0x7fa8d00a7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:45156/0 (socket says 172.21.15.55:45156) 2023-09-30T01:57:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8cffff700 1 -- 172.21.15.55:0/3196147726 learned_addr learned my addr 172.21.15.55:0/3196147726 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:08.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8ceffd700 1 --2- 172.21.15.55:0/3196147726 >> v2:172.21.15.133:3300/0 conn(0x7fa8d013e5f0 0x7fa8d013ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8cffff700 1 -- 172.21.15.55:0/3196147726 >> v2:172.21.15.133:3300/0 conn(0x7fa8d013e5f0 msgr2=0x7fa8d013ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:57:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8cffff700 1 --2- 172.21.15.55:0/3196147726 >> v2:172.21.15.133:3300/0 conn(0x7fa8d013e5f0 0x7fa8d013ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8cffff700 1 -- 172.21.15.55:0/3196147726 >> v1:172.21.15.133:6789/0 conn(0x7fa8d00b3060 legacy=0x7fa8d00a6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.463+0000 7fa8cffff700 1 -- 172.21.15.55:0/3196147726 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d00a8180 con 0x7fa8d00a7810 2023-09-30T01:57:08.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8cffff700 1 --2- 172.21.15.55:0/3196147726 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8d00a7810 0x7fa8d00a7c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80099b0 tx=0x7fa8c8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32b57e72882bdbe9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8ce7fc700 1 -- 172.21.15.55:0/3196147726 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8009ea0 con 0x7fa8d00a7810 2023-09-30T01:57:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8ce7fc700 1 -- 172.21.15.55:0/3196147726 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c800b860 con 0x7fa8d00a7810 2023-09-30T01:57:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8ce7fc700 1 -- 172.21.15.55:0/3196147726 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c800bc00 con 0x7fa8d00a7810 2023-09-30T01:57:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/3196147726 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8d00a7810 msgr2=0x7fa8d00a7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 --2- 172.21.15.55:0/3196147726 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8d00a7810 0x7fa8d00a7c40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa8c80099b0 tx=0x7fa8c8009250 comp rx=0 tx=0).stop 2023-09-30T01:57:08.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/3196147726 shutdown_connections 2023-09-30T01:57:08.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 --2- 172.21.15.55:0/3196147726 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8d00a7810 0x7fa8d00a7c40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:08.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 --2- 172.21.15.55:0/3196147726 >> v2:172.21.15.133:3300/0 conn(0x7fa8d013e5f0 0x7fa8d013ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:08.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/3196147726 >> 172.21.15.55:0/3196147726 conn(0x7fa8d0068b00 msgr2=0x7fa8d00b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:08.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/3196147726 shutdown_connections 2023-09-30T01:57:08.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/3196147726 wait complete. 2023-09-30T01:57:08.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 Processor -- start 2023-09-30T01:57:08.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 -- start start 2023-09-30T01:57:08.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00a7810 0x7fa8d0142720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:08.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d00b3060 0x7fa8d00ad4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:08.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8d013e5f0 0x7fa8d006acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:08.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d006c570 con 0x7fa8d00b3060 2023-09-30T01:57:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d0150b40 con 0x7fa8d00a7810 2023-09-30T01:57:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8d5cb4700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d00ae150 con 0x7fa8d013e5f0 2023-09-30T01:57:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8cffff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8d013e5f0 0x7fa8d006acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8cffff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8d013e5f0 0x7fa8d006acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:45170/0 (socket says 172.21.15.55:45170) 2023-09-30T01:57:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8cffff700 1 -- 172.21.15.55:0/43672970 learned_addr learned my addr 172.21.15.55:0/43672970 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.467+0000 7fa8ceffd700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d00b3060 0x7fa8d00ad4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.471+0000 7fa8cf7fe700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00a7810 0x7fa8d0142720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.471+0000 7fa8cffff700 1 -- 172.21.15.55:0/43672970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00a7810 msgr2=0x7fa8d0142720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.471+0000 7fa8cffff700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00a7810 0x7fa8d0142720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.471+0000 7fa8cffff700 1 -- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d00b3060 msgr2=0x7fa8d00ad4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:08.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.471+0000 7fa8cffff700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d00b3060 0x7fa8d00ad4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.471+0000 7fa8cffff700 1 -- 172.21.15.55:0/43672970 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c80094f0 con 0x7fa8d013e5f0 2023-09-30T01:57:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.471+0000 7fa8ceffd700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d00b3060 0x7fa8d00ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:57:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.471+0000 7fa8cffff700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8d013e5f0 0x7fa8d006acf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8006fd0 tx=0x7fa8c8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.471+0000 7fa8c77fe700 1 -- 172.21.15.55:0/43672970 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8011420 con 0x7fa8d013e5f0 2023-09-30T01:57:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.471+0000 7fa8c77fe700 1 -- 172.21.15.55:0/43672970 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8c80115a0 con 0x7fa8d013e5f0 2023-09-30T01:57:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.471+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/43672970 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d00aee20 con 0x7fa8d013e5f0 2023-09-30T01:57:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.471+0000 7fa8c77fe700 1 -- 172.21.15.55:0/43672970 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8c8011960 con 0x7fa8d013e5f0 2023-09-30T01:57:08.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.471+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/43672970 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d0142d50 con 0x7fa8d013e5f0 2023-09-30T01:57:08.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.471+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/43672970 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d0068300 con 0x7fa8d013e5f0 2023-09-30T01:57:08.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.475+0000 7fa8c77fe700 1 -- 172.21.15.55:0/43672970 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fa8c8011d10 con 0x7fa8d013e5f0 2023-09-30T01:57:08.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.475+0000 7fa8c77fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.475+0000 7fa8c77fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.475+0000 7fa8c77fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.475+0000 7fa8c77fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.475+0000 7fa8c77fe700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa8b008e8b0 0x7fa8b0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.475+0000 7fa8c77fe700 1 -- 172.21.15.55:0/43672970 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fa8c80b6a00 con 0x7fa8d013e5f0 2023-09-30T01:57:08.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.475+0000 7fa8cf7fe700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa8b008e8b0 0x7fa8b0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:08.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.475+0000 7fa8cf7fe700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa8b008e8b0 0x7fa8b0090d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0007fd0 tx=0x7fa8c00016f0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:08.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.483+0000 7fa8c77fe700 1 -- 172.21.15.55:0/43672970 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa8c8087430 con 0x7fa8d013e5f0 2023-09-30T01:57:08.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.679+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/43672970 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa8d004b5c0 con 0x7fa8d013e5f0 2023-09-30T01:57:08.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.679+0000 7fa8c77fe700 1 -- 172.21.15.55:0/43672970 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa8c8015100 con 0x7fa8d013e5f0 2023-09-30T01:57:08.683 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:08.683 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.679+0000 7fa8d5cb4700 10 mgrc shutdown 2023-09-30T01:57:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.683+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa8b008e8b0 msgr2=0x7fa8b0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.683+0000 7fa8d5cb4700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa8b008e8b0 0x7fa8b0090d60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa8c0007fd0 tx=0x7fa8c00016f0 comp rx=0 tx=0).stop 2023-09-30T01:57:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.683+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8d013e5f0 msgr2=0x7fa8d006acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.683+0000 7fa8d5cb4700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8d013e5f0 0x7fa8d006acf0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fa8c8006fd0 tx=0x7fa8c8017000 comp rx=0 tx=0).stop 2023-09-30T01:57:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.683+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/43672970 shutdown_connections 2023-09-30T01:57:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.683+0000 7fa8d5cb4700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa8b008e8b0 0x7fa8b0090d60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.683+0000 7fa8d5cb4700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa8d013e5f0 0x7fa8d006acf0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:08.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.683+0000 7fa8d5cb4700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa8d00b3060 0x7fa8d00ad4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:08.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.683+0000 7fa8d5cb4700 1 --2- 172.21.15.55:0/43672970 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa8d00a7810 0x7fa8d0142720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:08.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.683+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/43672970 >> 172.21.15.55:0/43672970 conn(0x7fa8d0068b00 msgr2=0x7fa8d00a6020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:08.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.683+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/43672970 shutdown_connections 2023-09-30T01:57:08.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:08.683+0000 7fa8d5cb4700 1 -- 172.21.15.55:0/43672970 wait complete. 2023-09-30T01:57:11.698 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:11.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f115aa24700 1 Processor -- start 2023-09-30T01:57:11.814 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f115aa24700 1 -- start start 2023-09-30T01:57:11.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f115aa24700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f115413d6c0 0x7f115406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:11.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f115aa24700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115406c810 con 0x7f11541488a0 2023-09-30T01:57:11.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f115aa24700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11541409e0 con 0x7f115406ff20 2023-09-30T01:57:11.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f115aa24700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1154068750 con 0x7f115413d6c0 2023-09-30T01:57:11.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f1159a22700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f115413d6c0 0x7f115406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:11.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f115a223700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f11541488a0 0x7f115414ac80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35822/0 (socket says 172.21.15.55:35822) 2023-09-30T01:57:11.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f115a223700 1 -- 172.21.15.55:0/2582717246 learned_addr learned my addr 172.21.15.55:0/2582717246 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:57:11.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f1158a20700 1 -- 172.21.15.55:0/2582717246 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1473854175 0 0) 0x7f11541409e0 con 0x7f115406ff20 2023-09-30T01:57:11.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f1159a22700 1 -- 172.21.15.55:0/2582717246 >> v1:172.21.15.133:6789/0 conn(0x7f115406ff20 legacy=0x7f115413feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:11.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f1159a22700 1 -- 172.21.15.55:0/2582717246 >> v1:172.21.15.55:6789/0 conn(0x7f11541488a0 legacy=0x7f115414ac80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f1159a22700 1 -- 172.21.15.55:0/2582717246 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1154140ca0 con 0x7f115413d6c0 2023-09-30T01:57:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f1159a22700 1 --2- 172.21.15.55:0/2582717246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115413d6c0 0x7f115406c2d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f11500098e0 tx=0x7f11500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f0f59319549312 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f1158a20700 1 -- 172.21.15.55:0/2582717246 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1150009e80 con 0x7f115413d6c0 2023-09-30T01:57:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f1158a20700 1 -- 172.21.15.55:0/2582717246 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f115000b760 con 0x7f115413d6c0 2023-09-30T01:57:11.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.811+0000 7f1158a20700 1 -- 172.21.15.55:0/2582717246 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f115000bae0 con 0x7f115413d6c0 2023-09-30T01:57:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 -- 172.21.15.55:0/2582717246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115413d6c0 msgr2=0x7f115406c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 --2- 172.21.15.55:0/2582717246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115413d6c0 0x7f115406c2d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f11500098e0 tx=0x7f11500091a0 comp rx=0 tx=0).stop 2023-09-30T01:57:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 -- 172.21.15.55:0/2582717246 shutdown_connections 2023-09-30T01:57:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 --2- 172.21.15.55:0/2582717246 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115413d6c0 0x7f115406c2d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 -- 172.21.15.55:0/2582717246 >> 172.21.15.55:0/2582717246 conn(0x7f11540b2cf0 msgr2=0x7f11540b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 -- 172.21.15.55:0/2582717246 shutdown_connections 2023-09-30T01:57:11.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 -- 172.21.15.55:0/2582717246 wait complete. 2023-09-30T01:57:11.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 Processor -- start 2023-09-30T01:57:11.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 -- start start 2023-09-30T01:57:11.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115406ff20 0x7f11540b2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:11.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f115413d6c0 0x7f11540aaea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:11.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11541488a0 0x7f1154153740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:11.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11540ac660 con 0x7f115406ff20 2023-09-30T01:57:11.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11540ac920 con 0x7f11541488a0 2023-09-30T01:57:11.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115aa24700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1154151250 con 0x7f115413d6c0 2023-09-30T01:57:11.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f1159a22700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115406ff20 0x7f11540b2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f1159221700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f115413d6c0 0x7f11540aaea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f1159221700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f115413d6c0 0x7f11540aaea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:41390/0 (socket says 172.21.15.55:41390) 2023-09-30T01:57:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f1159a22700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115406ff20 0x7f11540b2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44096/0 (socket says 172.21.15.55:44096) 2023-09-30T01:57:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f1159221700 1 -- 172.21.15.55:0/1005922279 learned_addr learned my addr 172.21.15.55:0/1005922279 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:11.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f115a223700 1 --2- 172.21.15.55:0/1005922279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11541488a0 0x7f1154153740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f1159221700 1 -- 172.21.15.55:0/1005922279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11541488a0 msgr2=0x7f1154153740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f1159221700 1 --2- 172.21.15.55:0/1005922279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11541488a0 0x7f1154153740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f1159221700 1 -- 172.21.15.55:0/1005922279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115406ff20 msgr2=0x7f11540b2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f1159221700 1 --2- 172.21.15.55:0/1005922279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115406ff20 0x7f11540b2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:11.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f1159221700 1 -- 172.21.15.55:0/1005922279 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1150009420 con 0x7f115413d6c0 2023-09-30T01:57:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.815+0000 7f1159a22700 1 --2- 172.21.15.55:0/1005922279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115406ff20 0x7f11540b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:57:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.819+0000 7f1159221700 1 --2- 172.21.15.55:0/1005922279 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f115413d6c0 0x7f11540aaea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f114400cb60 tx=0x7f11440017a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.819+0000 7f1149ffb700 1 -- 172.21.15.55:0/1005922279 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11440020b0 con 0x7f115413d6c0 2023-09-30T01:57:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.819+0000 7f1149ffb700 1 -- 172.21.15.55:0/1005922279 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114400a7e0 con 0x7f115413d6c0 2023-09-30T01:57:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.819+0000 7f115aa24700 1 -- 172.21.15.55:0/1005922279 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11540ab3e0 con 0x7f115413d6c0 2023-09-30T01:57:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.819+0000 7f1149ffb700 1 -- 172.21.15.55:0/1005922279 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114400aba0 con 0x7f115413d6c0 2023-09-30T01:57:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.819+0000 7f115aa24700 1 -- 172.21.15.55:0/1005922279 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1154146eb0 con 0x7f115413d6c0 2023-09-30T01:57:11.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.819+0000 7f115aa24700 1 -- 172.21.15.55:0/1005922279 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1154064440 con 0x7f115413d6c0 2023-09-30T01:57:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.819+0000 7f1149ffb700 1 -- 172.21.15.55:0/1005922279 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f1144003030 con 0x7f115413d6c0 2023-09-30T01:57:11.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.819+0000 7f1149ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:11.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.823+0000 7f1149ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:11.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.823+0000 7f1149ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:11.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.823+0000 7f1149ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:11.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.823+0000 7f1149ffb700 1 --2- 172.21.15.55:0/1005922279 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f114008e8b0 0x7f1140090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:11.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.823+0000 7f1149ffb700 1 -- 172.21.15.55:0/1005922279 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f11440b48f0 con 0x7f115413d6c0 2023-09-30T01:57:11.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.823+0000 7f1159a22700 1 --2- 172.21.15.55:0/1005922279 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f114008e8b0 0x7f1140090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:11.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.823+0000 7f1159a22700 1 --2- 172.21.15.55:0/1005922279 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f114008e8b0 0x7f1140090d60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f11500030c0 tx=0x7f1150016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:11.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:11.827+0000 7f1149ffb700 1 -- 172.21.15.55:0/1005922279 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1144085290 con 0x7f115413d6c0 2023-09-30T01:57:12.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.019+0000 7f115aa24700 1 -- 172.21.15.55:0/1005922279 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f11540a2c60 con 0x7f115413d6c0 2023-09-30T01:57:12.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.019+0000 7f1149ffb700 1 -- 172.21.15.55:0/1005922279 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f11440888b0 con 0x7f115413d6c0 2023-09-30T01:57:12.025 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:12.025 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:12.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.023+0000 7f115aa24700 10 mgrc shutdown 2023-09-30T01:57:12.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.023+0000 7f115aa24700 1 -- 172.21.15.55:0/1005922279 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f114008e8b0 msgr2=0x7f1140090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:12.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.023+0000 7f115aa24700 1 --2- 172.21.15.55:0/1005922279 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f114008e8b0 0x7f1140090d60 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f11500030c0 tx=0x7f1150016000 comp rx=0 tx=0).stop 2023-09-30T01:57:12.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.023+0000 7f115aa24700 1 -- 172.21.15.55:0/1005922279 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f115413d6c0 msgr2=0x7f11540aaea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:12.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.023+0000 7f115aa24700 1 --2- 172.21.15.55:0/1005922279 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f115413d6c0 0x7f11540aaea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f114400cb60 tx=0x7f11440017a0 comp rx=0 tx=0).stop 2023-09-30T01:57:12.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.023+0000 7f115aa24700 1 -- 172.21.15.55:0/1005922279 shutdown_connections 2023-09-30T01:57:12.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.023+0000 7f115aa24700 1 --2- 172.21.15.55:0/1005922279 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f11541488a0 0x7f1154153740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:12.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.023+0000 7f115aa24700 1 --2- 172.21.15.55:0/1005922279 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f114008e8b0 0x7f1140090d60 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:12.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.023+0000 7f115aa24700 1 --2- 172.21.15.55:0/1005922279 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f115413d6c0 0x7f11540aaea0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:12.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.023+0000 7f115aa24700 1 --2- 172.21.15.55:0/1005922279 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115406ff20 0x7f11540b2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:12.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.023+0000 7f115aa24700 1 -- 172.21.15.55:0/1005922279 >> 172.21.15.55:0/1005922279 conn(0x7f11540b2cf0 msgr2=0x7f115406d990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:12.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.027+0000 7f115aa24700 1 -- 172.21.15.55:0/1005922279 shutdown_connections 2023-09-30T01:57:12.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:12.027+0000 7f115aa24700 1 -- 172.21.15.55:0/1005922279 wait complete. 2023-09-30T01:57:13.888 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:57:13.891 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:57:15.046 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:15.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f989a473700 1 Processor -- start 2023-09-30T01:57:15.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f989a473700 1 -- start start 2023-09-30T01:57:15.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f989a473700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98940a8f70 0x7f989406b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:15.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f989a473700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f989413ff60 con 0x7f989413fb90 2023-09-30T01:57:15.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f989a473700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9894143f00 con 0x7f98940a88d0 2023-09-30T01:57:15.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f989a473700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98941441a0 con 0x7f98940a8f70 2023-09-30T01:57:15.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f9899c72700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98940a8f70 0x7f989406b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:15.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f9899471700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f989413fb90 0x7f98941436b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35836/0 (socket says 172.21.15.55:35836) 2023-09-30T01:57:15.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f9899471700 1 -- 172.21.15.55:0/3924190130 learned_addr learned my addr 172.21.15.55:0/3924190130 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:57:15.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f988bfff700 1 -- 172.21.15.55:0/3924190130 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81214172 0 0) 0x7f989413ff60 con 0x7f989413fb90 2023-09-30T01:57:15.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f988bfff700 1 -- 172.21.15.55:0/3924190130 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9880003570 con 0x7f989413fb90 2023-09-30T01:57:15.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f988bfff700 1 -- 172.21.15.55:0/3924190130 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110487485 0 0) 0x7f9894143f00 con 0x7f98940a88d0 2023-09-30T01:57:15.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f988bfff700 1 -- 172.21.15.55:0/3924190130 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f989413ff60 con 0x7f98940a88d0 2023-09-30T01:57:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f9899c72700 1 -- 172.21.15.55:0/3924190130 >> v1:172.21.15.133:6789/0 conn(0x7f98940a88d0 legacy=0x7f98940670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f9899c72700 1 -- 172.21.15.55:0/3924190130 >> v1:172.21.15.55:6789/0 conn(0x7f989413fb90 legacy=0x7f98941436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f9899c72700 1 -- 172.21.15.55:0/3924190130 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9894067e80 con 0x7f98940a8f70 2023-09-30T01:57:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.158+0000 7f9899c72700 1 --2- 172.21.15.55:0/3924190130 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98940a8f70 0x7f989406b7b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f988c009e90 tx=0x7f988c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eaf0c65f9f1ff93b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.162+0000 7f988bfff700 1 -- 172.21.15.55:0/3924190130 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c00e070 con 0x7f98940a8f70 2023-09-30T01:57:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.162+0000 7f988bfff700 1 -- 172.21.15.55:0/3924190130 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f988c00bc10 con 0x7f98940a8f70 2023-09-30T01:57:15.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.162+0000 7f988bfff700 1 -- 172.21.15.55:0/3924190130 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f988c012430 con 0x7f98940a8f70 2023-09-30T01:57:15.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.162+0000 7f989a473700 1 -- 172.21.15.55:0/3924190130 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98940a8f70 msgr2=0x7f989406b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:15.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.162+0000 7f989a473700 1 --2- 172.21.15.55:0/3924190130 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98940a8f70 0x7f989406b7b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f988c009e90 tx=0x7f988c009780 comp rx=0 tx=0).stop 2023-09-30T01:57:15.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.162+0000 7f989a473700 1 -- 172.21.15.55:0/3924190130 shutdown_connections 2023-09-30T01:57:15.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.162+0000 7f989a473700 1 --2- 172.21.15.55:0/3924190130 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98940a8f70 0x7f989406b7b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:15.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.162+0000 7f989a473700 1 -- 172.21.15.55:0/3924190130 >> 172.21.15.55:0/3924190130 conn(0x7f98940b44c0 msgr2=0x7f98940b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:15.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.162+0000 7f989a473700 1 -- 172.21.15.55:0/3924190130 shutdown_connections 2023-09-30T01:57:15.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.162+0000 7f989a473700 1 -- 172.21.15.55:0/3924190130 wait complete. 2023-09-30T01:57:15.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.162+0000 7f989a473700 1 Processor -- start 2023-09-30T01:57:15.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.162+0000 7f989a473700 1 -- start start 2023-09-30T01:57:15.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f989a473700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98940a88d0 0x7f98941457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:15.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f989a473700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98940a8f70 0x7f989413d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:15.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f989a473700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f989413fb90 0x7f9894137720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:15.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f989a473700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f989413dfa0 con 0x7f98940a8f70 2023-09-30T01:57:15.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f989a473700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9894138630 con 0x7f989413fb90 2023-09-30T01:57:15.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f989a473700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f989413d490 con 0x7f98940a88d0 2023-09-30T01:57:15.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f9899471700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98940a88d0 0x7f98941457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:15.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f9899471700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98940a88d0 0x7f98941457d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:41408/0 (socket says 172.21.15.55:41408) 2023-09-30T01:57:15.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f9899471700 1 -- 172.21.15.55:0/475798167 learned_addr learned my addr 172.21.15.55:0/475798167 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:15.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f9898c70700 1 --2- 172.21.15.55:0/475798167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98940a8f70 0x7f989413d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:15.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f9899c72700 1 --2- 172.21.15.55:0/475798167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f989413fb90 0x7f9894137720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f9898c70700 1 -- 172.21.15.55:0/475798167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98940a88d0 msgr2=0x7f98941457d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f9898c70700 1 --2- 172.21.15.55:0/475798167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98940a88d0 0x7f98941457d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f9898c70700 1 -- 172.21.15.55:0/475798167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f989413fb90 msgr2=0x7f9894137720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f9898c70700 1 --2- 172.21.15.55:0/475798167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f989413fb90 0x7f9894137720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f9898c70700 1 -- 172.21.15.55:0/475798167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f988c009a20 con 0x7f98940a8f70 2023-09-30T01:57:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f9898c70700 1 --2- 172.21.15.55:0/475798167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98940a8f70 0x7f989413d8e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9890000c00 tx=0x7f9890007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f98897fa700 1 -- 172.21.15.55:0/475798167 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f989000ce10 con 0x7f98940a8f70 2023-09-30T01:57:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f98897fa700 1 -- 172.21.15.55:0/475798167 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9890011590 con 0x7f98940a8f70 2023-09-30T01:57:15.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f989a473700 1 -- 172.21.15.55:0/475798167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9894137c60 con 0x7f98940a8f70 2023-09-30T01:57:15.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f98897fa700 1 -- 172.21.15.55:0/475798167 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9890011950 con 0x7f98940a8f70 2023-09-30T01:57:15.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.166+0000 7f989a473700 1 -- 172.21.15.55:0/475798167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9894138000 con 0x7f98940a8f70 2023-09-30T01:57:15.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.170+0000 7f989a473700 1 -- 172.21.15.55:0/475798167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9894064440 con 0x7f98940a8f70 2023-09-30T01:57:15.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.170+0000 7f98897fa700 1 -- 172.21.15.55:0/475798167 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f9890011d40 con 0x7f98940a8f70 2023-09-30T01:57:15.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.170+0000 7f98897fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:15.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.170+0000 7f98897fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:15.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.170+0000 7f98897fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:15.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.170+0000 7f98897fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:15.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.170+0000 7f98897fa700 1 --2- 172.21.15.55:0/475798167 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f987808e8e0 0x7f9878090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:15.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.174+0000 7f9899471700 1 --2- 172.21.15.55:0/475798167 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f987808e8e0 0x7f9878090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:15.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.174+0000 7f98897fa700 1 -- 172.21.15.55:0/475798167 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f98900b4310 con 0x7f98940a8f70 2023-09-30T01:57:15.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.174+0000 7f9899471700 1 --2- 172.21.15.55:0/475798167 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f987808e8e0 0x7f9878090d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f98840058d0 tx=0x7f9884009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:15.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.178+0000 7f98897fa700 1 -- 172.21.15.55:0/475798167 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9890084d40 con 0x7f98940a8f70 2023-09-30T01:57:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.370+0000 7f989a473700 1 -- 172.21.15.55:0/475798167 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f989414ba60 con 0x7f98940a8f70 2023-09-30T01:57:15.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.370+0000 7f98897fa700 1 -- 172.21.15.55:0/475798167 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f9890088360 con 0x7f98940a8f70 2023-09-30T01:57:15.375 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:15.375 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:15.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.370+0000 7f989a473700 10 mgrc shutdown 2023-09-30T01:57:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.370+0000 7f989a473700 1 -- 172.21.15.55:0/475798167 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f987808e8e0 msgr2=0x7f9878090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.370+0000 7f989a473700 1 --2- 172.21.15.55:0/475798167 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f987808e8e0 0x7f9878090d90 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f98840058d0 tx=0x7f9884009040 comp rx=0 tx=0).stop 2023-09-30T01:57:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.370+0000 7f989a473700 1 -- 172.21.15.55:0/475798167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98940a8f70 msgr2=0x7f989413d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.370+0000 7f989a473700 1 --2- 172.21.15.55:0/475798167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98940a8f70 0x7f989413d8e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9890000c00 tx=0x7f9890007d30 comp rx=0 tx=0).stop 2023-09-30T01:57:15.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.374+0000 7f989a473700 1 -- 172.21.15.55:0/475798167 shutdown_connections 2023-09-30T01:57:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.374+0000 7f989a473700 1 --2- 172.21.15.55:0/475798167 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f989413fb90 0x7f9894137720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.374+0000 7f989a473700 1 --2- 172.21.15.55:0/475798167 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f98940a8f70 0x7f989413d8e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.374+0000 7f989a473700 1 --2- 172.21.15.55:0/475798167 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f987808e8e0 0x7f9878090d90 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.374+0000 7f989a473700 1 --2- 172.21.15.55:0/475798167 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f98940a88d0 0x7f98941457d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.374+0000 7f989a473700 1 -- 172.21.15.55:0/475798167 >> 172.21.15.55:0/475798167 conn(0x7f98940b44c0 msgr2=0x7f98940b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.374+0000 7f989a473700 1 -- 172.21.15.55:0/475798167 shutdown_connections 2023-09-30T01:57:15.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:15.374+0000 7f989a473700 1 -- 172.21.15.55:0/475798167 wait complete. 2023-09-30T01:57:18.389 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:18.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26eab47700 1 Processor -- start 2023-09-30T01:57:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26eab47700 1 -- start start 2023-09-30T01:57:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26eab47700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f26e413f820 0x7f26e413fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26eab47700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f26e40a5ec0 0x7f26e406e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26eab47700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26e40a62b0 con 0x7f26e406ff20 2023-09-30T01:57:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26eab47700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e406e9a0 con 0x7f26e40a5ec0 2023-09-30T01:57:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26eab47700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26e4140220 con 0x7f26e413f820 2023-09-30T01:57:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26e90e4700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f26e406ff20 0x7f26e406cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35846/0 (socket says 172.21.15.55:35846) 2023-09-30T01:57:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26e90e4700 1 -- 172.21.15.55:0/1146256478 learned_addr learned my addr 172.21.15.55:0/1146256478 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:57:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26e3fff700 1 --2- 172.21.15.55:0/1146256478 >> v2:172.21.15.55:3300/0 conn(0x7f26e40a5ec0 0x7f26e406e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:18.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26e88e3700 1 --2- 172.21.15.55:0/1146256478 >> v2:172.21.15.133:3300/0 conn(0x7f26e413f820 0x7f26e413fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:18.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26e37fe700 1 -- 172.21.15.55:0/1146256478 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2938806986 0 0) 0x7f26e40a62b0 con 0x7f26e406ff20 2023-09-30T01:57:18.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26e37fe700 1 -- 172.21.15.55:0/1146256478 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f26d0003570 con 0x7f26e406ff20 2023-09-30T01:57:18.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26e37fe700 1 -- 172.21.15.55:0/1146256478 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3344277830 0 0) 0x7f26d0003570 con 0x7f26e406ff20 2023-09-30T01:57:18.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26e3fff700 1 -- 172.21.15.55:0/1146256478 >> v2:172.21.15.133:3300/0 conn(0x7f26e413f820 msgr2=0x7f26e413fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:57:18.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26e3fff700 1 --2- 172.21.15.55:0/1146256478 >> v2:172.21.15.133:3300/0 conn(0x7f26e413f820 0x7f26e413fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:18.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26e3fff700 1 -- 172.21.15.55:0/1146256478 >> v1:172.21.15.55:6789/0 conn(0x7f26e406ff20 legacy=0x7f26e406cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:18.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26e3fff700 1 -- 172.21.15.55:0/1146256478 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26e4070360 con 0x7f26e40a5ec0 2023-09-30T01:57:18.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.502+0000 7f26e88e3700 1 --2- 172.21.15.55:0/1146256478 >> v2:172.21.15.133:3300/0 conn(0x7f26e413f820 0x7f26e413fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:57:18.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26e3fff700 1 --2- 172.21.15.55:0/1146256478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26e40a5ec0 0x7f26e406e460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f26e4063b60 tx=0x7f26cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb783d74983824d8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:18.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26e37fe700 1 -- 172.21.15.55:0/1146256478 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d4001470 con 0x7f26e40a5ec0 2023-09-30T01:57:18.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26e37fe700 1 -- 172.21.15.55:0/1146256478 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26cc011420 con 0x7f26e40a5ec0 2023-09-30T01:57:18.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26e37fe700 1 -- 172.21.15.55:0/1146256478 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26cc0117a0 con 0x7f26e40a5ec0 2023-09-30T01:57:18.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 -- 172.21.15.55:0/1146256478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26e40a5ec0 msgr2=0x7f26e406e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:18.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 --2- 172.21.15.55:0/1146256478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26e40a5ec0 0x7f26e406e460 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f26e4063b60 tx=0x7f26cc0091a0 comp rx=0 tx=0).stop 2023-09-30T01:57:18.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 -- 172.21.15.55:0/1146256478 shutdown_connections 2023-09-30T01:57:18.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 --2- 172.21.15.55:0/1146256478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26e40a5ec0 0x7f26e406e460 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:18.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 --2- 172.21.15.55:0/1146256478 >> v2:172.21.15.133:3300/0 conn(0x7f26e413f820 0x7f26e413fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:18.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 -- 172.21.15.55:0/1146256478 >> 172.21.15.55:0/1146256478 conn(0x7f26e40b3060 msgr2=0x7f26e40b3460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:18.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 -- 172.21.15.55:0/1146256478 shutdown_connections 2023-09-30T01:57:18.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 -- 172.21.15.55:0/1146256478 wait complete. 2023-09-30T01:57:18.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 Processor -- start 2023-09-30T01:57:18.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 -- start start 2023-09-30T01:57:18.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26e406ff20 0x7f26e4097990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:18.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26e40a5ec0 0x7f26e4150020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:18.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26e413f820 0x7f26e40960a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:18.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e4150560 con 0x7f26e413f820 2023-09-30T01:57:18.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26e4151310 con 0x7f26e40a5ec0 2023-09-30T01:57:18.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26eab47700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26e4150740 con 0x7f26e406ff20 2023-09-30T01:57:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26e88e3700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26e406ff20 0x7f26e4097990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26e88e3700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26e406ff20 0x7f26e4097990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:41424/0 (socket says 172.21.15.55:41424) 2023-09-30T01:57:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26e88e3700 1 -- 172.21.15.55:0/2384819366 learned_addr learned my addr 172.21.15.55:0/2384819366 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26e90e4700 1 --2- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26e413f820 0x7f26e40960a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26e88e3700 1 -- 172.21.15.55:0/2384819366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26e40a5ec0 msgr2=0x7f26e4150020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26e88e3700 1 --2- 172.21.15.55:0/2384819366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26e40a5ec0 0x7f26e4150020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26e88e3700 1 -- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26e413f820 msgr2=0x7f26e40960a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26e88e3700 1 --2- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26e413f820 0x7f26e40960a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26e88e3700 1 -- 172.21.15.55:0/2384819366 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26dc009a20 con 0x7f26e406ff20 2023-09-30T01:57:18.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.506+0000 7f26e90e4700 1 --2- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26e413f820 0x7f26e40960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:57:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.510+0000 7f26e88e3700 1 --2- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26e406ff20 0x7f26e4097990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00c0c0 tx=0x7f26dc00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.510+0000 7f26e0ff9700 1 -- 172.21.15.55:0/2384819366 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc00cd40 con 0x7f26e406ff20 2023-09-30T01:57:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.510+0000 7f26e0ff9700 1 -- 172.21.15.55:0/2384819366 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26dc00f040 con 0x7f26e406ff20 2023-09-30T01:57:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.510+0000 7f26eab47700 1 -- 172.21.15.55:0/2384819366 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26cc009420 con 0x7f26e406ff20 2023-09-30T01:57:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.510+0000 7f26e0ff9700 1 -- 172.21.15.55:0/2384819366 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26dc014690 con 0x7f26e406ff20 2023-09-30T01:57:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.510+0000 7f26eab47700 1 -- 172.21.15.55:0/2384819366 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26e40b2030 con 0x7f26e406ff20 2023-09-30T01:57:18.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.510+0000 7f26eab47700 1 -- 172.21.15.55:0/2384819366 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26e4068c70 con 0x7f26e406ff20 2023-09-30T01:57:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.514+0000 7f26e0ff9700 1 -- 172.21.15.55:0/2384819366 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f26dc014a00 con 0x7f26e406ff20 2023-09-30T01:57:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.514+0000 7f26e0ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.514+0000 7f26e0ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.514+0000 7f26e0ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.514+0000 7f26e0ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.514+0000 7f26e0ff9700 1 --2- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f26c408e8e0 0x7f26c4090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:18.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.514+0000 7f26e0ff9700 1 -- 172.21.15.55:0/2384819366 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f26dc0b5d40 con 0x7f26e406ff20 2023-09-30T01:57:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.514+0000 7f26e3fff700 1 --2- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f26c408e8e0 0x7f26c4090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:18.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.514+0000 7f26e3fff700 1 --2- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f26c408e8e0 0x7f26c4090d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f26e4063b60 tx=0x7f26cc016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:18.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.518+0000 7f26e0ff9700 1 -- 172.21.15.55:0/2384819366 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f26dc052be0 con 0x7f26e406ff20 2023-09-30T01:57:18.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.714+0000 7f26eab47700 1 -- 172.21.15.55:0/2384819366 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f26e406d380 con 0x7f26e406ff20 2023-09-30T01:57:18.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.714+0000 7f26e0ff9700 1 -- 172.21.15.55:0/2384819366 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f26dc08a0d0 con 0x7f26e406ff20 2023-09-30T01:57:18.720 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:18.720 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:18.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.718+0000 7f26eab47700 10 mgrc shutdown 2023-09-30T01:57:18.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.718+0000 7f26eab47700 1 -- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f26c408e8e0 msgr2=0x7f26c4090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:18.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.718+0000 7f26eab47700 1 --2- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f26c408e8e0 0x7f26c4090d90 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f26e4063b60 tx=0x7f26cc016000 comp rx=0 tx=0).stop 2023-09-30T01:57:18.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.718+0000 7f26eab47700 1 -- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26e406ff20 msgr2=0x7f26e4097990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:18.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.718+0000 7f26eab47700 1 --2- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26e406ff20 0x7f26e4097990 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f26dc00c0c0 tx=0x7f26dc00b040 comp rx=0 tx=0).stop 2023-09-30T01:57:18.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.718+0000 7f26eab47700 1 -- 172.21.15.55:0/2384819366 shutdown_connections 2023-09-30T01:57:18.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.718+0000 7f26eab47700 1 --2- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f26e413f820 0x7f26e40960a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:18.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.718+0000 7f26eab47700 1 --2- 172.21.15.55:0/2384819366 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f26e40a5ec0 0x7f26e4150020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:18.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.718+0000 7f26eab47700 1 --2- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f26c408e8e0 0x7f26c4090d90 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:18.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.718+0000 7f26eab47700 1 --2- 172.21.15.55:0/2384819366 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f26e406ff20 0x7f26e4097990 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:18.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.718+0000 7f26eab47700 1 -- 172.21.15.55:0/2384819366 >> 172.21.15.55:0/2384819366 conn(0x7f26e40b3060 msgr2=0x7f26e40677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:18.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.718+0000 7f26eab47700 1 -- 172.21.15.55:0/2384819366 shutdown_connections 2023-09-30T01:57:18.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:18.718+0000 7f26eab47700 1 -- 172.21.15.55:0/2384819366 wait complete. 2023-09-30T01:57:21.741 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:21.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01f2d50700 1 Processor -- start 2023-09-30T01:57:21.855 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01f2d50700 1 -- start start 2023-09-30T01:57:21.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01f2d50700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01ec068630 0x7f01ec140a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:21.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01f2d50700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01ec0a65b0 0x7f01ec14aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:21.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01f2d50700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01ec068a00 con 0x7f01ec0a61e0 2023-09-30T01:57:21.857 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01f2d50700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01ec0a69f0 con 0x7f01ec068630 2023-09-30T01:57:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01f2d50700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec140330 con 0x7f01ec0a65b0 2023-09-30T01:57:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01f0aec700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f01ec068630 0x7f01ec140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01ebfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f01ec0a61e0 0x7f01ec0a54e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54208/0 (socket says 172.21.15.55:54208) 2023-09-30T01:57:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01ebfff700 1 -- 172.21.15.55:0/7251724 learned_addr learned my addr 172.21.15.55:0/7251724 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:57:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01f12ed700 1 --2- 172.21.15.55:0/7251724 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01ec0a65b0 0x7f01ec14aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01eb7fe700 1 -- 172.21.15.55:0/7251724 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2181847142 0 0) 0x7f01ec068a00 con 0x7f01ec0a61e0 2023-09-30T01:57:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01eb7fe700 1 -- 172.21.15.55:0/7251724 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01d4003570 con 0x7f01ec0a61e0 2023-09-30T01:57:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01f0aec700 1 -- 172.21.15.55:0/7251724 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01ec0a65b0 msgr2=0x7f01ec14aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:57:21.858 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01f0aec700 1 --2- 172.21.15.55:0/7251724 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01ec0a65b0 0x7f01ec14aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01f0aec700 1 -- 172.21.15.55:0/7251724 >> v1:172.21.15.55:6789/0 conn(0x7f01ec0a61e0 legacy=0x7f01ec0a54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01f0aec700 1 -- 172.21.15.55:0/7251724 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ec1405f0 con 0x7f01ec068630 2023-09-30T01:57:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.850+0000 7f01f12ed700 1 --2- 172.21.15.55:0/7251724 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01ec0a65b0 0x7f01ec14aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:57:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.854+0000 7f01f0aec700 1 --2- 172.21.15.55:0/7251724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec068630 0x7f01ec140a40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009e60 tx=0x7f01e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cdcfba1cca6fedd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.854+0000 7f01eb7fe700 1 -- 172.21.15.55:0/7251724 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e400e070 con 0x7f01ec068630 2023-09-30T01:57:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.854+0000 7f01eb7fe700 1 -- 172.21.15.55:0/7251724 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01e400bb40 con 0x7f01ec068630 2023-09-30T01:57:21.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.854+0000 7f01eb7fe700 1 -- 172.21.15.55:0/7251724 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01e4012430 con 0x7f01ec068630 2023-09-30T01:57:21.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.854+0000 7f01f2d50700 1 -- 172.21.15.55:0/7251724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec068630 msgr2=0x7f01ec140a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:21.860 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.854+0000 7f01f2d50700 1 --2- 172.21.15.55:0/7251724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec068630 0x7f01ec140a40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f01e4009e60 tx=0x7f01e4009780 comp rx=0 tx=0).stop 2023-09-30T01:57:21.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.854+0000 7f01f2d50700 1 -- 172.21.15.55:0/7251724 shutdown_connections 2023-09-30T01:57:21.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.854+0000 7f01f2d50700 1 --2- 172.21.15.55:0/7251724 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01ec0a65b0 0x7f01ec14aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:21.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.854+0000 7f01f2d50700 1 --2- 172.21.15.55:0/7251724 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec068630 0x7f01ec140a40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:21.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.854+0000 7f01f2d50700 1 -- 172.21.15.55:0/7251724 >> 172.21.15.55:0/7251724 conn(0x7f01ec06aeb0 msgr2=0x7f01ec06b2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:21.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.854+0000 7f01f2d50700 1 -- 172.21.15.55:0/7251724 shutdown_connections 2023-09-30T01:57:21.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.854+0000 7f01f2d50700 1 -- 172.21.15.55:0/7251724 wait complete. 2023-09-30T01:57:21.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.854+0000 7f01f2d50700 1 Processor -- start 2023-09-30T01:57:21.861 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.854+0000 7f01f2d50700 1 -- start start 2023-09-30T01:57:21.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f2d50700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01ec068630 0x7f01ec1430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:21.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f2d50700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01ec0a61e0 0x7f01ec0abe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:21.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f2d50700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec0a65b0 0x7f01ec153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f2d50700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec0ac390 con 0x7f01ec0a65b0 2023-09-30T01:57:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f2d50700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec143df0 con 0x7f01ec068630 2023-09-30T01:57:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f2d50700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01ec154280 con 0x7f01ec0a61e0 2023-09-30T01:57:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01ebfff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01ec0a61e0 0x7f01ec0abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01ebfff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01ec0a61e0 0x7f01ec0abe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:34154/0 (socket says 172.21.15.55:34154) 2023-09-30T01:57:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01ebfff700 1 -- 172.21.15.55:0/358737984 learned_addr learned my addr 172.21.15.55:0/358737984 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f12ed700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec0a65b0 0x7f01ec153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f0aec700 1 --2- 172.21.15.55:0/358737984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01ec068630 0x7f01ec1430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:21.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f12ed700 1 -- 172.21.15.55:0/358737984 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01ec0a61e0 msgr2=0x7f01ec0abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f12ed700 1 --2- 172.21.15.55:0/358737984 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01ec0a61e0 0x7f01ec0abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f12ed700 1 -- 172.21.15.55:0/358737984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01ec068630 msgr2=0x7f01ec1430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f12ed700 1 --2- 172.21.15.55:0/358737984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01ec068630 0x7f01ec1430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f12ed700 1 -- 172.21.15.55:0/358737984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01dc009420 con 0x7f01ec0a65b0 2023-09-30T01:57:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01ebfff700 1 --2- 172.21.15.55:0/358737984 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01ec0a61e0 0x7f01ec0abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:57:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f12ed700 1 --2- 172.21.15.55:0/358737984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec0a65b0 0x7f01ec153820 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00e970 tx=0x7f01dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01e8ff9700 1 -- 172.21.15.55:0/358737984 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc013680 con 0x7f01ec0a65b0 2023-09-30T01:57:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01e8ff9700 1 -- 172.21.15.55:0/358737984 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01dc0137e0 con 0x7f01ec0a65b0 2023-09-30T01:57:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f2d50700 1 -- 172.21.15.55:0/358737984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01e4009a20 con 0x7f01ec0a65b0 2023-09-30T01:57:21.865 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01e8ff9700 1 -- 172.21.15.55:0/358737984 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01dc013b80 con 0x7f01ec0a65b0 2023-09-30T01:57:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.858+0000 7f01f2d50700 1 -- 172.21.15.55:0/358737984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01ec137220 con 0x7f01ec0a65b0 2023-09-30T01:57:21.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.862+0000 7f01f2d50700 1 -- 172.21.15.55:0/358737984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01ec1545d0 con 0x7f01ec0a65b0 2023-09-30T01:57:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.862+0000 7f01e8ff9700 1 -- 172.21.15.55:0/358737984 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f01dc01b400 con 0x7f01ec0a65b0 2023-09-30T01:57:21.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.862+0000 7f01e8ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:21.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.862+0000 7f01e8ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:21.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.862+0000 7f01e8ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:21.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.862+0000 7f01e8ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:21.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.862+0000 7f01e8ff9700 1 --2- 172.21.15.55:0/358737984 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f01d808e8e0 0x7f01d8090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:21.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.862+0000 7f01f0aec700 1 --2- 172.21.15.55:0/358737984 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f01d808e8e0 0x7f01d8090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:21.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.862+0000 7f01e8ff9700 1 -- 172.21.15.55:0/358737984 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f01dc0b49b0 con 0x7f01ec0a65b0 2023-09-30T01:57:21.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.866+0000 7f01f0aec700 1 --2- 172.21.15.55:0/358737984 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f01d808e8e0 0x7f01d8090d90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f01e40097c0 tx=0x7f01e4019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:21.878 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:21.874+0000 7f01e8ff9700 1 -- 172.21.15.55:0/358737984 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f01dc0853e0 con 0x7f01ec0a65b0 2023-09-30T01:57:22.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.070+0000 7f01f2d50700 1 -- 172.21.15.55:0/358737984 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f01ec137440 con 0x7f01ec0a65b0 2023-09-30T01:57:22.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.070+0000 7f01e8ff9700 1 -- 172.21.15.55:0/358737984 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f01dc088a00 con 0x7f01ec0a65b0 2023-09-30T01:57:22.076 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:22.076 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.074+0000 7f01f2d50700 10 mgrc shutdown 2023-09-30T01:57:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.074+0000 7f01f2d50700 1 -- 172.21.15.55:0/358737984 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f01d808e8e0 msgr2=0x7f01d8090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.074+0000 7f01f2d50700 1 --2- 172.21.15.55:0/358737984 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f01d808e8e0 0x7f01d8090d90 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f01e40097c0 tx=0x7f01e4019000 comp rx=0 tx=0).stop 2023-09-30T01:57:22.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.074+0000 7f01f2d50700 1 -- 172.21.15.55:0/358737984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec0a65b0 msgr2=0x7f01ec153820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.074+0000 7f01f2d50700 1 --2- 172.21.15.55:0/358737984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec0a65b0 0x7f01ec153820 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f01dc00e970 tx=0x7f01dc0091a0 comp rx=0 tx=0).stop 2023-09-30T01:57:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.074+0000 7f01f2d50700 1 -- 172.21.15.55:0/358737984 shutdown_connections 2023-09-30T01:57:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.074+0000 7f01f2d50700 1 --2- 172.21.15.55:0/358737984 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f01ec0a65b0 0x7f01ec153820 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.074+0000 7f01f2d50700 1 --2- 172.21.15.55:0/358737984 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f01d808e8e0 0x7f01d8090d90 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.074+0000 7f01f2d50700 1 --2- 172.21.15.55:0/358737984 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f01ec0a61e0 0x7f01ec0abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.074+0000 7f01f2d50700 1 --2- 172.21.15.55:0/358737984 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f01ec068630 0x7f01ec1430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.074+0000 7f01f2d50700 1 -- 172.21.15.55:0/358737984 >> 172.21.15.55:0/358737984 conn(0x7f01ec06aeb0 msgr2=0x7f01ec06d540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.074+0000 7f01f2d50700 1 -- 172.21.15.55:0/358737984 shutdown_connections 2023-09-30T01:57:22.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:22.074+0000 7f01f2d50700 1 -- 172.21.15.55:0/358737984 wait complete. 2023-09-30T01:57:25.091 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:25.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f6013fff700 1 Processor -- start 2023-09-30T01:57:25.207 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f6013fff700 1 -- start start 2023-09-30T01:57:25.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f6013fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f60140a9130 0x7f601406b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:25.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f6013fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6014136030 0x7f6014136470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:25.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f6013fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60140a38e0 con 0x7f60140a3d70 2023-09-30T01:57:25.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f6013fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f601406bae0 con 0x7f60140a9130 2023-09-30T01:57:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f6013fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60140a69c0 con 0x7f6014136030 2023-09-30T01:57:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f60137fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6014136030 0x7f6014136470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f60137fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6014136030 0x7f6014136470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:34162/0 (socket says 172.21.15.55:34162) 2023-09-30T01:57:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f60137fe700 1 -- 172.21.15.55:0/2288848113 learned_addr learned my addr 172.21.15.55:0/2288848113 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f6012ffd700 1 --2- 172.21.15.55:0/2288848113 >> v2:172.21.15.133:3300/0 conn(0x7f60140a9130 0x7f601406b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f60137fe700 1 -- 172.21.15.55:0/2288848113 >> v2:172.21.15.133:3300/0 conn(0x7f60140a9130 msgr2=0x7f601406b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:57:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f60137fe700 1 --2- 172.21.15.55:0/2288848113 >> v2:172.21.15.133:3300/0 conn(0x7f60140a9130 0x7f601406b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f60137fe700 1 -- 172.21.15.55:0/2288848113 >> v1:172.21.15.133:6789/0 conn(0x7f60140a3d70 legacy=0x7f60140a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:57:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f60137fe700 1 -- 172.21.15.55:0/2288848113 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60140a9500 con 0x7f6014136030 2023-09-30T01:57:25.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f6012ffd700 1 --2- 172.21.15.55:0/2288848113 >> v2:172.21.15.133:3300/0 conn(0x7f60140a9130 0x7f601406b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T01:57:25.211 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.202+0000 7f60137fe700 1 --2- 172.21.15.55:0/2288848113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6014136030 0x7f6014136470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f600c009f20 tx=0x7f600c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64112208b15fded8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:25.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6011ffb700 1 -- 172.21.15.55:0/2288848113 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c00e070 con 0x7f6014136030 2023-09-30T01:57:25.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6011ffb700 1 -- 172.21.15.55:0/2288848113 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c00ba40 con 0x7f6014136030 2023-09-30T01:57:25.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6011ffb700 1 -- 172.21.15.55:0/2288848113 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c0092e0 con 0x7f6014136030 2023-09-30T01:57:25.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 -- 172.21.15.55:0/2288848113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6014136030 msgr2=0x7f6014136470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:25.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 --2- 172.21.15.55:0/2288848113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6014136030 0x7f6014136470 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f600c009f20 tx=0x7f600c009840 comp rx=0 tx=0).stop 2023-09-30T01:57:25.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 -- 172.21.15.55:0/2288848113 shutdown_connections 2023-09-30T01:57:25.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 --2- 172.21.15.55:0/2288848113 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6014136030 0x7f6014136470 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:25.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 --2- 172.21.15.55:0/2288848113 >> v2:172.21.15.133:3300/0 conn(0x7f60140a9130 0x7f601406b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:25.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 -- 172.21.15.55:0/2288848113 >> 172.21.15.55:0/2288848113 conn(0x7f60140b6940 msgr2=0x7f60140b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:25.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 -- 172.21.15.55:0/2288848113 shutdown_connections 2023-09-30T01:57:25.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 -- 172.21.15.55:0/2288848113 wait complete. 2023-09-30T01:57:25.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 Processor -- start 2023-09-30T01:57:25.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 -- start start 2023-09-30T01:57:25.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140a3d70 0x7f6014145fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:25.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60140a9130 0x7f60140b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:25.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6014136030 0x7f601412cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:25.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601412d9e0 con 0x7f60140a9130 2023-09-30T01:57:25.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f601412dc80 con 0x7f60140a3d70 2023-09-30T01:57:25.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6013fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60141464e0 con 0x7f6014136030 2023-09-30T01:57:25.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f60137fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6014136030 0x7f601412cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:25.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f60137fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6014136030 0x7f601412cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:34176/0 (socket says 172.21.15.55:34176) 2023-09-30T01:57:25.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f60137fe700 1 -- 172.21.15.55:0/3365536971 learned_addr learned my addr 172.21.15.55:0/3365536971 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f60127fc700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60140a9130 0x7f60140b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.206+0000 7f6012ffd700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140a3d70 0x7f6014145fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.210+0000 7f60137fe700 1 -- 172.21.15.55:0/3365536971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140a3d70 msgr2=0x7f6014145fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.210+0000 7f60137fe700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140a3d70 0x7f6014145fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.210+0000 7f60137fe700 1 -- 172.21.15.55:0/3365536971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60140a9130 msgr2=0x7f60140b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.210+0000 7f60137fe700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60140a9130 0x7f60140b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.210+0000 7f60137fe700 1 -- 172.21.15.55:0/3365536971 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f600c009ae0 con 0x7f6014136030 2023-09-30T01:57:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.210+0000 7f6012ffd700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140a3d70 0x7f6014145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:57:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.210+0000 7f60137fe700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6014136030 0x7f601412cfa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f601406bc20 tx=0x7f600c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.210+0000 7f600affd700 1 -- 172.21.15.55:0/3365536971 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c012db0 con 0x7f6014136030 2023-09-30T01:57:25.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.210+0000 7f600affd700 1 -- 172.21.15.55:0/3365536971 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f600c01d420 con 0x7f6014136030 2023-09-30T01:57:25.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.210+0000 7f6013fff700 1 -- 172.21.15.55:0/3365536971 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6014131710 con 0x7f6014136030 2023-09-30T01:57:25.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.210+0000 7f600affd700 1 -- 172.21.15.55:0/3365536971 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f600c01d7e0 con 0x7f6014136030 2023-09-30T01:57:25.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.210+0000 7f6013fff700 1 -- 172.21.15.55:0/3365536971 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60140a4140 con 0x7f6014136030 2023-09-30T01:57:25.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.210+0000 7f6013fff700 1 -- 172.21.15.55:0/3365536971 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6014131980 con 0x7f6014136030 2023-09-30T01:57:25.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.214+0000 7f600affd700 1 -- 172.21.15.55:0/3365536971 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f600c01dbd0 con 0x7f6014136030 2023-09-30T01:57:25.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.214+0000 7f600affd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:25.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.214+0000 7f600affd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:25.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.214+0000 7f600affd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:25.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.214+0000 7f600affd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:25.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.214+0000 7f600affd700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5ff408e8b0 0x7f5ff4090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:25.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.214+0000 7f600affd700 1 -- 172.21.15.55:0/3365536971 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f600c0b6260 con 0x7f6014136030 2023-09-30T01:57:25.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.214+0000 7f6012ffd700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5ff408e8b0 0x7f5ff4090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:25.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.214+0000 7f6012ffd700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5ff408e8b0 0x7f5ff4090d60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc00ac10 tx=0x7f5ffc006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:25.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.222+0000 7f600affd700 1 -- 172.21.15.55:0/3365536971 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f600c086bf0 con 0x7f6014136030 2023-09-30T01:57:25.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.426+0000 7f6013fff700 1 -- 172.21.15.55:0/3365536971 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6014064440 con 0x7f6014136030 2023-09-30T01:57:25.432 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.426+0000 7f600affd700 1 -- 172.21.15.55:0/3365536971 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f600c08a210 con 0x7f6014136030 2023-09-30T01:57:25.432 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:25.432 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.430+0000 7f6013fff700 10 mgrc shutdown 2023-09-30T01:57:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.430+0000 7f6013fff700 1 -- 172.21.15.55:0/3365536971 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5ff408e8b0 msgr2=0x7f5ff4090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:25.434 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.430+0000 7f6013fff700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5ff408e8b0 0x7f5ff4090d60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5ffc00ac10 tx=0x7f5ffc006f90 comp rx=0 tx=0).stop 2023-09-30T01:57:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.430+0000 7f6013fff700 1 -- 172.21.15.55:0/3365536971 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6014136030 msgr2=0x7f601412cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.430+0000 7f6013fff700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6014136030 0x7f601412cfa0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f601406bc20 tx=0x7f600c017000 comp rx=0 tx=0).stop 2023-09-30T01:57:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.430+0000 7f6013fff700 1 -- 172.21.15.55:0/3365536971 shutdown_connections 2023-09-30T01:57:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.430+0000 7f6013fff700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5ff408e8b0 0x7f5ff4090d60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.430+0000 7f6013fff700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6014136030 0x7f601412cfa0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.430+0000 7f6013fff700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f60140a9130 0x7f60140b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.430+0000 7f6013fff700 1 --2- 172.21.15.55:0/3365536971 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f60140a3d70 0x7f6014145fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.430+0000 7f6013fff700 1 -- 172.21.15.55:0/3365536971 >> 172.21.15.55:0/3365536971 conn(0x7f60140b6940 msgr2=0x7f601406bf80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.430+0000 7f6013fff700 1 -- 172.21.15.55:0/3365536971 shutdown_connections 2023-09-30T01:57:25.435 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:25.430+0000 7f6013fff700 1 -- 172.21.15.55:0/3365536971 wait complete. 2023-09-30T01:57:28.446 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:28.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7cfe1e1700 1 Processor -- start 2023-09-30T01:57:28.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7cfe1e1700 1 -- start start 2023-09-30T01:57:28.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7cfe1e1700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7cf80affa0 0x7f7cf806d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:28.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7cfe1e1700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf80a58d0 con 0x7f7cf8145390 2023-09-30T01:57:28.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7cfe1e1700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cf8140180 con 0x7f7cf8140b10 2023-09-30T01:57:28.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7cfe1e1700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cf806dab0 con 0x7f7cf80affa0 2023-09-30T01:57:28.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7cfc9de700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f7cf80affa0 0x7f7cf806d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:28.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7cfd9e0700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f7cf8145390 0x7f7cf8147770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54218/0 (socket says 172.21.15.55:54218) 2023-09-30T01:57:28.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7cfd9e0700 1 -- 172.21.15.55:0/2938398070 learned_addr learned my addr 172.21.15.55:0/2938398070 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:57:28.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7cfc9de700 1 -- 172.21.15.55:0/2938398070 >> v1:172.21.15.133:6789/0 conn(0x7f7cf8140b10 legacy=0x7f7cf80a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:28.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7cfc9de700 1 -- 172.21.15.55:0/2938398070 >> v1:172.21.15.55:6789/0 conn(0x7f7cf8145390 legacy=0x7f7cf8147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:28.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7cfc9de700 1 -- 172.21.15.55:0/2938398070 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cf806e120 con 0x7f7cf80affa0 2023-09-30T01:57:28.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7ceffff700 1 -- 172.21.15.55:0/2938398070 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 213134880 0 0) 0x7f7cf80a58d0 con 0x7f7cf8145390 2023-09-30T01:57:28.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7cfc9de700 1 --2- 172.21.15.55:0/2938398070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80affa0 0x7f7cf806d120 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80098e0 tx=0x7f7ce80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c830f0ebe971c60e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:28.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7ceffff700 1 -- 172.21.15.55:0/2938398070 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce8009e80 con 0x7f7cf80affa0 2023-09-30T01:57:28.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7ceffff700 1 -- 172.21.15.55:0/2938398070 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ce800b860 con 0x7f7cf80affa0 2023-09-30T01:57:28.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.554+0000 7f7ceffff700 1 -- 172.21.15.55:0/2938398070 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ce800bbe0 con 0x7f7cf80affa0 2023-09-30T01:57:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/2938398070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80affa0 msgr2=0x7f7cf806d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 --2- 172.21.15.55:0/2938398070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80affa0 0x7f7cf806d120 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f7ce80098e0 tx=0x7f7ce80091a0 comp rx=0 tx=0).stop 2023-09-30T01:57:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/2938398070 shutdown_connections 2023-09-30T01:57:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 --2- 172.21.15.55:0/2938398070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf80affa0 0x7f7cf806d120 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/2938398070 >> 172.21.15.55:0/2938398070 conn(0x7f7cf80681b0 msgr2=0x7f7cf80685b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/2938398070 shutdown_connections 2023-09-30T01:57:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/2938398070 wait complete. 2023-09-30T01:57:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 Processor -- start 2023-09-30T01:57:28.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 -- start start 2023-09-30T01:57:28.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf80affa0 0x7f7cf813f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:28.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7cf8140b10 0x7f7cf8136020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:28.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf8145390 0x7f7cf80a69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:28.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf814dcb0 con 0x7f7cf8145390 2023-09-30T01:57:28.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf8151d10 con 0x7f7cf80affa0 2023-09-30T01:57:28.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfe1e1700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cf8151fd0 con 0x7f7cf8140b10 2023-09-30T01:57:28.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfc9de700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7cf8140b10 0x7f7cf8136020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:28.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfd9e0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf8145390 0x7f7cf80a69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:28.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfc9de700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7cf8140b10 0x7f7cf8136020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:34184/0 (socket says 172.21.15.55:34184) 2023-09-30T01:57:28.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfc9de700 1 -- 172.21.15.55:0/279981508 learned_addr learned my addr 172.21.15.55:0/279981508 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:28.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfd1df700 1 --2- 172.21.15.55:0/279981508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf80affa0 0x7f7cf813f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:28.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfd9e0700 1 -- 172.21.15.55:0/279981508 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7cf8140b10 msgr2=0x7f7cf8136020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:28.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfd9e0700 1 --2- 172.21.15.55:0/279981508 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7cf8140b10 0x7f7cf8136020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:28.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.558+0000 7f7cfd9e0700 1 -- 172.21.15.55:0/279981508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf80affa0 msgr2=0x7f7cf813f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:28.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.562+0000 7f7cfd9e0700 1 --2- 172.21.15.55:0/279981508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf80affa0 0x7f7cf813f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:28.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.562+0000 7f7cfd9e0700 1 -- 172.21.15.55:0/279981508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ce8009420 con 0x7f7cf8145390 2023-09-30T01:57:28.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.562+0000 7f7cfd9e0700 1 --2- 172.21.15.55:0/279981508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf8145390 0x7f7cf80a69b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7cf813dbc0 tx=0x7f7cf00019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:28.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.562+0000 7f7ced7fa700 1 -- 172.21.15.55:0/279981508 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf000a8b0 con 0x7f7cf8145390 2023-09-30T01:57:28.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.562+0000 7f7ced7fa700 1 -- 172.21.15.55:0/279981508 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf000aa30 con 0x7f7cf8145390 2023-09-30T01:57:28.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.562+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/279981508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cf80a72b0 con 0x7f7cf8145390 2023-09-30T01:57:28.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.562+0000 7f7ced7fa700 1 -- 172.21.15.55:0/279981508 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf000adf0 con 0x7f7cf8145390 2023-09-30T01:57:28.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.562+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/279981508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cf81515b0 con 0x7f7cf8145390 2023-09-30T01:57:28.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.562+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/279981508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cf80a6fd0 con 0x7f7cf8145390 2023-09-30T01:57:28.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.566+0000 7f7ced7fa700 1 -- 172.21.15.55:0/279981508 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f7cf0007300 con 0x7f7cf8145390 2023-09-30T01:57:28.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.566+0000 7f7ced7fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:28.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.566+0000 7f7ced7fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:28.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.566+0000 7f7ced7fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:28.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.566+0000 7f7ced7fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:28.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.566+0000 7f7ced7fa700 1 --2- 172.21.15.55:0/279981508 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7cdc08e8b0 0x7f7cdc090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:28.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.566+0000 7f7cfd1df700 1 --2- 172.21.15.55:0/279981508 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7cdc08e8b0 0x7f7cdc090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:28.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.566+0000 7f7ced7fa700 1 -- 172.21.15.55:0/279981508 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f7cf00b4c30 con 0x7f7cf8145390 2023-09-30T01:57:28.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.566+0000 7f7cfd1df700 1 --2- 172.21.15.55:0/279981508 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7cdc08e8b0 0x7f7cdc090d60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4003a80 tx=0x7f7cf4007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:28.579 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.574+0000 7f7ced7fa700 1 -- 172.21.15.55:0/279981508 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7cf80a6fd0 con 0x7f7cf8145390 2023-09-30T01:57:28.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.770+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/279981508 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7cf80a6fd0 con 0x7f7cf8145390 2023-09-30T01:57:28.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.770+0000 7f7ced7fa700 1 -- 172.21.15.55:0/279981508 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f7cf80a6fd0 con 0x7f7cf8145390 2023-09-30T01:57:28.776 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:28.776 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:28.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.774+0000 7f7cfe1e1700 10 mgrc shutdown 2023-09-30T01:57:28.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.774+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/279981508 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7cdc08e8b0 msgr2=0x7f7cdc090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:28.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.774+0000 7f7cfe1e1700 1 --2- 172.21.15.55:0/279981508 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7cdc08e8b0 0x7f7cdc090d60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7cf4003a80 tx=0x7f7cf4007ec0 comp rx=0 tx=0).stop 2023-09-30T01:57:28.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.774+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/279981508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf8145390 msgr2=0x7f7cf80a69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:28.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.774+0000 7f7cfe1e1700 1 --2- 172.21.15.55:0/279981508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf8145390 0x7f7cf80a69b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7cf813dbc0 tx=0x7f7cf00019a0 comp rx=0 tx=0).stop 2023-09-30T01:57:28.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.774+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/279981508 shutdown_connections 2023-09-30T01:57:28.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.774+0000 7f7cfe1e1700 1 --2- 172.21.15.55:0/279981508 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7cf8145390 0x7f7cf80a69b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:28.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.774+0000 7f7cfe1e1700 1 --2- 172.21.15.55:0/279981508 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7cdc08e8b0 0x7f7cdc090d60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:28.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.774+0000 7f7cfe1e1700 1 --2- 172.21.15.55:0/279981508 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7cf8140b10 0x7f7cf8136020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:28.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.774+0000 7f7cfe1e1700 1 --2- 172.21.15.55:0/279981508 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7cf80affa0 0x7f7cf813f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:28.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.774+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/279981508 >> 172.21.15.55:0/279981508 conn(0x7f7cf80681b0 msgr2=0x7f7cf813d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:28.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.774+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/279981508 shutdown_connections 2023-09-30T01:57:28.781 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:28.774+0000 7f7cfe1e1700 1 -- 172.21.15.55:0/279981508 wait complete. 2023-09-30T01:57:31.796 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:31.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.902+0000 7fcee359e700 1 Processor -- start 2023-09-30T01:57:31.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.902+0000 7fcee359e700 1 -- start start 2023-09-30T01:57:31.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcee40a5bb0 0x7fcee406c7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:31.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcee406ff20 0x7fcee40a34c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:31.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcee40a4150 con 0x7fcee4070310 2023-09-30T01:57:31.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcee40a5f80 con 0x7fcee406ff20 2023-09-30T01:57:31.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee40686c0 con 0x7fcee40a5bb0 2023-09-30T01:57:31.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee259c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcee40a5bb0 0x7fcee406c7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:31.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee259c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcee40a5bb0 0x7fcee406c7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:52458/0 (socket says 172.21.15.55:52458) 2023-09-30T01:57:31.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee259c700 1 -- 172.21.15.55:0/4147859217 learned_addr learned my addr 172.21.15.55:0/4147859217 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:31.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee1d9b700 1 --2- 172.21.15.55:0/4147859217 >> v2:172.21.15.133:3300/0 conn(0x7fcee406ff20 0x7fcee40a34c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:31.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee259c700 1 -- 172.21.15.55:0/4147859217 >> v2:172.21.15.133:3300/0 conn(0x7fcee406ff20 msgr2=0x7fcee40a34c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:57:31.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee259c700 1 --2- 172.21.15.55:0/4147859217 >> v2:172.21.15.133:3300/0 conn(0x7fcee406ff20 0x7fcee40a34c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:31.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee259c700 1 -- 172.21.15.55:0/4147859217 >> v1:172.21.15.133:6789/0 conn(0x7fcee4070310 legacy=0x7fcee4147910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:31.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee259c700 1 -- 172.21.15.55:0/4147859217 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcee413e6d0 con 0x7fcee40a5bb0 2023-09-30T01:57:31.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee259c700 1 --2- 172.21.15.55:0/4147859217 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcee40a5bb0 0x7fcee406c7c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0099a0 tx=0x7fcecc009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=507b335fcee852e7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:31.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee159a700 1 -- 172.21.15.55:0/4147859217 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc009e90 con 0x7fcee40a5bb0 2023-09-30T01:57:31.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee159a700 1 -- 172.21.15.55:0/4147859217 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcecc00b860 con 0x7fcee40a5bb0 2023-09-30T01:57:31.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee159a700 1 -- 172.21.15.55:0/4147859217 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcecc00bc20 con 0x7fcee40a5bb0 2023-09-30T01:57:31.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 -- 172.21.15.55:0/4147859217 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcee40a5bb0 msgr2=0x7fcee406c7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:31.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 --2- 172.21.15.55:0/4147859217 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcee40a5bb0 0x7fcee406c7c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0099a0 tx=0x7fcecc009250 comp rx=0 tx=0).stop 2023-09-30T01:57:31.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 -- 172.21.15.55:0/4147859217 shutdown_connections 2023-09-30T01:57:31.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 --2- 172.21.15.55:0/4147859217 >> v2:172.21.15.133:3300/0 conn(0x7fcee406ff20 0x7fcee40a34c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:31.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 --2- 172.21.15.55:0/4147859217 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcee40a5bb0 0x7fcee406c7c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:31.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 -- 172.21.15.55:0/4147859217 >> 172.21.15.55:0/4147859217 conn(0x7fcee40b2cf0 msgr2=0x7fcee40b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:31.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 -- 172.21.15.55:0/4147859217 shutdown_connections 2023-09-30T01:57:31.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 -- 172.21.15.55:0/4147859217 wait complete. 2023-09-30T01:57:31.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 Processor -- start 2023-09-30T01:57:31.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.906+0000 7fcee359e700 1 -- start start 2023-09-30T01:57:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee406ff20 0x7fcee409e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee359e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcee40a5bb0 0x7fcee41580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee359e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcee4158620 0x7fcee4154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee359e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee4157ae0 con 0x7fcee4158620 2023-09-30T01:57:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcee4157c50 con 0x7fcee406ff20 2023-09-30T01:57:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee359e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcee41547c0 con 0x7fcee40a5bb0 2023-09-30T01:57:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee1d9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcee40a5bb0 0x7fcee41580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee1d9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcee40a5bb0 0x7fcee41580e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:52472/0 (socket says 172.21.15.55:52472) 2023-09-30T01:57:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee1d9b700 1 -- 172.21.15.55:0/2273115640 learned_addr learned my addr 172.21.15.55:0/2273115640 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:31.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee259c700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee406ff20 0x7fcee409e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee2d9d700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcee4158620 0x7fcee4154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee1d9b700 1 -- 172.21.15.55:0/2273115640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee406ff20 msgr2=0x7fcee409e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee1d9b700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee406ff20 0x7fcee409e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee1d9b700 1 -- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcee4158620 msgr2=0x7fcee4154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee1d9b700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcee4158620 0x7fcee4154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee1d9b700 1 -- 172.21.15.55:0/2273115640 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcecc009490 con 0x7fcee40a5bb0 2023-09-30T01:57:31.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee2d9d700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcee4158620 0x7fcee4154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:57:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee1d9b700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcee40a5bb0 0x7fcee41580e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fced4009e80 tx=0x7fced400b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fceda7fc700 1 -- 172.21.15.55:0/2273115640 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced400cb50 con 0x7fcee40a5bb0 2023-09-30T01:57:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fceda7fc700 1 -- 172.21.15.55:0/2273115640 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced400f040 con 0x7fcee40a5bb0 2023-09-30T01:57:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee359e700 1 -- 172.21.15.55:0/2273115640 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcee41544c0 con 0x7fcee40a5bb0 2023-09-30T01:57:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fceda7fc700 1 -- 172.21.15.55:0/2273115640 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4014480 con 0x7fcee40a5bb0 2023-09-30T01:57:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.910+0000 7fcee359e700 1 -- 172.21.15.55:0/2273115640 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcee413b530 con 0x7fcee40a5bb0 2023-09-30T01:57:31.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.914+0000 7fcee359e700 1 -- 172.21.15.55:0/2273115640 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcee4157de0 con 0x7fcee40a5bb0 2023-09-30T01:57:31.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.914+0000 7fceda7fc700 1 -- 172.21.15.55:0/2273115640 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fced40147f0 con 0x7fcee40a5bb0 2023-09-30T01:57:31.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.914+0000 7fceda7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:31.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.914+0000 7fceda7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:31.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.914+0000 7fceda7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:31.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.914+0000 7fceda7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:31.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.914+0000 7fceda7fc700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcec408e8b0 0x7fcec4090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:31.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.918+0000 7fcee259c700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcec408e8b0 0x7fcec4090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:31.921 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.918+0000 7fceda7fc700 1 -- 172.21.15.55:0/2273115640 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fced40b5930 con 0x7fcee40a5bb0 2023-09-30T01:57:31.922 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.918+0000 7fcee259c700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcec408e8b0 0x7fcec4090d60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0099a0 tx=0x7fcecc017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:31.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:31.922+0000 7fceda7fc700 1 -- 172.21.15.55:0/2273115640 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fced4086360 con 0x7fcee40a5bb0 2023-09-30T01:57:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.126+0000 7fcee359e700 1 -- 172.21.15.55:0/2273115640 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcee4064440 con 0x7fcee40a5bb0 2023-09-30T01:57:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.126+0000 7fceda7fc700 1 -- 172.21.15.55:0/2273115640 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fced4089980 con 0x7fcee40a5bb0 2023-09-30T01:57:32.131 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:32.131 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.130+0000 7fcee359e700 10 mgrc shutdown 2023-09-30T01:57:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.130+0000 7fcee359e700 1 -- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcec408e8b0 msgr2=0x7fcec4090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.130+0000 7fcee359e700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcec408e8b0 0x7fcec4090d60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fcecc0099a0 tx=0x7fcecc017000 comp rx=0 tx=0).stop 2023-09-30T01:57:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.130+0000 7fcee359e700 1 -- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcee40a5bb0 msgr2=0x7fcee41580e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.130+0000 7fcee359e700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcee40a5bb0 0x7fcee41580e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fced4009e80 tx=0x7fced400b040 comp rx=0 tx=0).stop 2023-09-30T01:57:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.130+0000 7fcee359e700 1 -- 172.21.15.55:0/2273115640 shutdown_connections 2023-09-30T01:57:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.130+0000 7fcee359e700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcee4158620 0x7fcee4154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.130+0000 7fcee359e700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcec408e8b0 0x7fcec4090d60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:32.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.130+0000 7fcee359e700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcee40a5bb0 0x7fcee41580e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.130+0000 7fcee359e700 1 --2- 172.21.15.55:0/2273115640 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcee406ff20 0x7fcee409e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.130+0000 7fcee359e700 1 -- 172.21.15.55:0/2273115640 >> 172.21.15.55:0/2273115640 conn(0x7fcee40b2cf0 msgr2=0x7fcee40a34c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.130+0000 7fcee359e700 1 -- 172.21.15.55:0/2273115640 shutdown_connections 2023-09-30T01:57:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:32.130+0000 7fcee359e700 1 -- 172.21.15.55:0/2273115640 wait complete. 2023-09-30T01:57:35.146 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:35.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.254+0000 7fcfb759e700 1 Processor -- start 2023-09-30T01:57:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.254+0000 7fcfb759e700 1 -- start start 2023-09-30T01:57:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb759e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcfb80a9130 0x7fcfb806b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb759e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb80a38e0 con 0x7fcfb8136030 2023-09-30T01:57:35.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb759e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfb80a69c0 con 0x7fcfb80a3d70 2023-09-30T01:57:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb759e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfb806bae0 con 0x7fcfb80a9130 2023-09-30T01:57:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb659c700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcfb80a9130 0x7fcfb806b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb6d9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcfb8136030 0x7fcfb8136430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45468/0 (socket says 172.21.15.55:45468) 2023-09-30T01:57:35.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb6d9d700 1 -- 172.21.15.55:0/1287273923 learned_addr learned my addr 172.21.15.55:0/1287273923 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:57:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb659c700 1 -- 172.21.15.55:0/1287273923 >> v1:172.21.15.133:6789/0 conn(0x7fcfb80a3d70 legacy=0x7fcfb80a4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb659c700 1 -- 172.21.15.55:0/1287273923 >> v1:172.21.15.55:6789/0 conn(0x7fcfb8136030 legacy=0x7fcfb8136430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb659c700 1 -- 172.21.15.55:0/1287273923 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb80a9500 con 0x7fcfb80a9130 2023-09-30T01:57:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb659c700 1 --2- 172.21.15.55:0/1287273923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb80a9130 0x7fcfb806b5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009e60 tx=0x7fcfb0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34da749590ceed3a server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb559a700 1 -- 172.21.15.55:0/1287273923 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb000e070 con 0x7fcfb80a9130 2023-09-30T01:57:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb559a700 1 -- 172.21.15.55:0/1287273923 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb000bc30 con 0x7fcfb80a9130 2023-09-30T01:57:35.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb559a700 1 -- 172.21.15.55:0/1287273923 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0012430 con 0x7fcfb80a9130 2023-09-30T01:57:35.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb759e700 1 -- 172.21.15.55:0/1287273923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb80a9130 msgr2=0x7fcfb806b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:35.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb759e700 1 --2- 172.21.15.55:0/1287273923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb80a9130 0x7fcfb806b5a0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009e60 tx=0x7fcfb0009780 comp rx=0 tx=0).stop 2023-09-30T01:57:35.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb759e700 1 -- 172.21.15.55:0/1287273923 shutdown_connections 2023-09-30T01:57:35.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb759e700 1 --2- 172.21.15.55:0/1287273923 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb80a9130 0x7fcfb806b5a0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:35.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb759e700 1 -- 172.21.15.55:0/1287273923 >> 172.21.15.55:0/1287273923 conn(0x7fcfb80b6940 msgr2=0x7fcfb80b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:35.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb759e700 1 -- 172.21.15.55:0/1287273923 shutdown_connections 2023-09-30T01:57:35.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.258+0000 7fcfb759e700 1 -- 172.21.15.55:0/1287273923 wait complete. 2023-09-30T01:57:35.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb759e700 1 Processor -- start 2023-09-30T01:57:35.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb759e700 1 -- start start 2023-09-30T01:57:35.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb759e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb80a3d70 0x7fcfb80a7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:35.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb759e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcfb80a9130 0x7fcfb8132600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:35.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb759e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb8136030 0x7fcfb80b44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:35.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb759e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb812efb0 con 0x7fcfb8136030 2023-09-30T01:57:35.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb759e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb812f270 con 0x7fcfb80a3d70 2023-09-30T01:57:35.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb759e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfb812f530 con 0x7fcfb80a9130 2023-09-30T01:57:35.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb5d9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcfb80a9130 0x7fcfb8132600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb5d9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcfb80a9130 0x7fcfb8132600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:52474/0 (socket says 172.21.15.55:52474) 2023-09-30T01:57:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb5d9b700 1 -- 172.21.15.55:0/2308251647 learned_addr learned my addr 172.21.15.55:0/2308251647 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb6d9d700 1 --2- 172.21.15.55:0/2308251647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb8136030 0x7fcfb80b44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb659c700 1 --2- 172.21.15.55:0/2308251647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb80a3d70 0x7fcfb80a7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb5d9b700 1 -- 172.21.15.55:0/2308251647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb80a3d70 msgr2=0x7fcfb80a7020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb5d9b700 1 --2- 172.21.15.55:0/2308251647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb80a3d70 0x7fcfb80a7020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb5d9b700 1 -- 172.21.15.55:0/2308251647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb8136030 msgr2=0x7fcfb80b44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb5d9b700 1 --2- 172.21.15.55:0/2308251647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb8136030 0x7fcfb80b44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb5d9b700 1 -- 172.21.15.55:0/2308251647 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb0009a20 con 0x7fcfb80a9130 2023-09-30T01:57:35.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb5d9b700 1 --2- 172.21.15.55:0/2308251647 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcfb80a9130 0x7fcfb8132600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c790 tx=0x7fcfac007f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:35.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfa67fc700 1 -- 172.21.15.55:0/2308251647 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac012630 con 0x7fcfb80a9130 2023-09-30T01:57:35.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfa67fc700 1 -- 172.21.15.55:0/2308251647 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfac0127b0 con 0x7fcfb80a9130 2023-09-30T01:57:35.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb759e700 1 -- 172.21.15.55:0/2308251647 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfb80a8030 con 0x7fcfb80a9130 2023-09-30T01:57:35.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfa67fc700 1 -- 172.21.15.55:0/2308251647 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfac012b70 con 0x7fcfb80a9130 2023-09-30T01:57:35.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.262+0000 7fcfb759e700 1 -- 172.21.15.55:0/2308251647 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfb8146480 con 0x7fcfb80a9130 2023-09-30T01:57:35.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.266+0000 7fcfa67fc700 1 -- 172.21.15.55:0/2308251647 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fcfac01b400 con 0x7fcfb80a9130 2023-09-30T01:57:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.266+0000 7fcfa67fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:35.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.266+0000 7fcfb759e700 1 -- 172.21.15.55:0/2308251647 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfb8131a00 con 0x7fcfb80a9130 2023-09-30T01:57:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.266+0000 7fcfa67fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.266+0000 7fcfa67fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.266+0000 7fcfa67fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.266+0000 7fcfa67fc700 1 --2- 172.21.15.55:0/2308251647 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcf9808e860 0x7fcf98090d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.266+0000 7fcfb659c700 1 --2- 172.21.15.55:0/2308251647 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcf9808e860 0x7fcf98090d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:35.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.266+0000 7fcfa67fc700 1 -- 172.21.15.55:0/2308251647 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fcfac0b4560 con 0x7fcfb80a9130 2023-09-30T01:57:35.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.266+0000 7fcfb659c700 1 --2- 172.21.15.55:0/2308251647 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcf9808e860 0x7fcf98090d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009e60 tx=0x7fcfb0019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:35.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.274+0000 7fcfa67fc700 1 -- 172.21.15.55:0/2308251647 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcfac084e60 con 0x7fcfb80a9130 2023-09-30T01:57:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.470+0000 7fcfb759e700 1 -- 172.21.15.55:0/2308251647 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcfb8064440 con 0x7fcfb80a9130 2023-09-30T01:57:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.470+0000 7fcfa67fc700 1 -- 172.21.15.55:0/2308251647 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fcfac088480 con 0x7fcfb80a9130 2023-09-30T01:57:35.475 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:35.475 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:35.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.474+0000 7fcfb759e700 10 mgrc shutdown 2023-09-30T01:57:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.474+0000 7fcfb759e700 1 -- 172.21.15.55:0/2308251647 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcf9808e860 msgr2=0x7fcf98090d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.474+0000 7fcfb759e700 1 --2- 172.21.15.55:0/2308251647 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcf9808e860 0x7fcf98090d10 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009e60 tx=0x7fcfb0019000 comp rx=0 tx=0).stop 2023-09-30T01:57:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.474+0000 7fcfb759e700 1 -- 172.21.15.55:0/2308251647 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcfb80a9130 msgr2=0x7fcfb8132600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.474+0000 7fcfb759e700 1 --2- 172.21.15.55:0/2308251647 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcfb80a9130 0x7fcfb8132600 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fcfac00c790 tx=0x7fcfac007f40 comp rx=0 tx=0).stop 2023-09-30T01:57:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.474+0000 7fcfb759e700 1 -- 172.21.15.55:0/2308251647 shutdown_connections 2023-09-30T01:57:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.474+0000 7fcfb759e700 1 --2- 172.21.15.55:0/2308251647 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcfb8136030 0x7fcfb80b44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.474+0000 7fcfb759e700 1 --2- 172.21.15.55:0/2308251647 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcf9808e860 0x7fcf98090d10 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.474+0000 7fcfb759e700 1 --2- 172.21.15.55:0/2308251647 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcfb80a9130 0x7fcfb8132600 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.474+0000 7fcfb759e700 1 --2- 172.21.15.55:0/2308251647 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcfb80a3d70 0x7fcfb80a7020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.474+0000 7fcfb759e700 1 -- 172.21.15.55:0/2308251647 >> 172.21.15.55:0/2308251647 conn(0x7fcfb80b6940 msgr2=0x7fcfb80a5140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:35.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.474+0000 7fcfb759e700 1 -- 172.21.15.55:0/2308251647 shutdown_connections 2023-09-30T01:57:35.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:35.474+0000 7fcfb759e700 1 -- 172.21.15.55:0/2308251647 wait complete. 2023-09-30T01:57:38.490 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:38.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.598+0000 7f86808b6700 1 Processor -- start 2023-09-30T01:57:38.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.598+0000 7f86808b6700 1 -- start start 2023-09-30T01:57:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.598+0000 7f86808b6700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f867c0a5eb0 0x7f867c14b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.598+0000 7f86808b6700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c067b90 con 0x7f867c0677c0 2023-09-30T01:57:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.598+0000 7f86808b6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f867c0a5460 con 0x7f867c0a65f0 2023-09-30T01:57:38.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.598+0000 7f86808b6700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c0a9ae0 con 0x7f867c0a5eb0 2023-09-30T01:57:38.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f867b7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f867c0677c0 0x7f867c0a93d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45484/0 (socket says 172.21.15.55:45484) 2023-09-30T01:57:38.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f867b7fe700 1 -- 172.21.15.55:0/2075025913 learned_addr learned my addr 172.21.15.55:0/2075025913 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:57:38.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f867bfff700 1 --2- 172.21.15.55:0/2075025913 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f867c0a5eb0 0x7f867c14b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:38.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f867a7fc700 1 -- 172.21.15.55:0/2075025913 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3680152893 0 0) 0x7f867c067b90 con 0x7f867c0677c0 2023-09-30T01:57:38.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f867a7fc700 1 -- 172.21.15.55:0/2075025913 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8664003570 con 0x7f867c0677c0 2023-09-30T01:57:38.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f867a7fc700 1 -- 172.21.15.55:0/2075025913 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2460365749 0 0) 0x7f867c0a5460 con 0x7f867c0a65f0 2023-09-30T01:57:38.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f867bfff700 1 -- 172.21.15.55:0/2075025913 >> v1:172.21.15.133:6789/0 conn(0x7f867c0a65f0 legacy=0x7f867c13f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:38.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f867bfff700 1 -- 172.21.15.55:0/2075025913 >> v1:172.21.15.55:6789/0 conn(0x7f867c0677c0 legacy=0x7f867c0a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:38.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f867bfff700 1 -- 172.21.15.55:0/2075025913 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c0a5720 con 0x7f867c0a5eb0 2023-09-30T01:57:38.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f867bfff700 1 --2- 172.21.15.55:0/2075025913 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f867c0a5eb0 0x7f867c14b9e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8674009e90 tx=0x7f8674009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ab1917c54c6d6aa3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f867a7fc700 1 -- 172.21.15.55:0/2075025913 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867400e070 con 0x7f867c0a5eb0 2023-09-30T01:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f867a7fc700 1 -- 172.21.15.55:0/2075025913 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867400bc30 con 0x7f867c0a5eb0 2023-09-30T01:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f867a7fc700 1 -- 172.21.15.55:0/2075025913 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8674012430 con 0x7f867c0a5eb0 2023-09-30T01:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f86808b6700 1 -- 172.21.15.55:0/2075025913 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f867c0a5eb0 msgr2=0x7f867c14b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f86808b6700 1 --2- 172.21.15.55:0/2075025913 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f867c0a5eb0 0x7f867c14b9e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8674009e90 tx=0x7f8674009780 comp rx=0 tx=0).stop 2023-09-30T01:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f86808b6700 1 -- 172.21.15.55:0/2075025913 shutdown_connections 2023-09-30T01:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f86808b6700 1 --2- 172.21.15.55:0/2075025913 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f867c0a5eb0 0x7f867c14b9e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:38.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f86808b6700 1 -- 172.21.15.55:0/2075025913 >> 172.21.15.55:0/2075025913 conn(0x7f867c068820 msgr2=0x7f867c068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:38.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f86808b6700 1 -- 172.21.15.55:0/2075025913 shutdown_connections 2023-09-30T01:57:38.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.602+0000 7f86808b6700 1 -- 172.21.15.55:0/2075025913 wait complete. 2023-09-30T01:57:38.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.606+0000 7f86808b6700 1 Processor -- start 2023-09-30T01:57:38.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.606+0000 7f86808b6700 1 -- start start 2023-09-30T01:57:38.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.606+0000 7f86808b6700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f867c0677c0 0x7f867c14f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:38.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.606+0000 7f86808b6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f867c0a5eb0 0x7f867c144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:38.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.606+0000 7f86808b6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f867c0a65f0 0x7f867c0b57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:38.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.606+0000 7f86808b6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c144540 con 0x7f867c0a5eb0 2023-09-30T01:57:38.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.606+0000 7f86808b6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c14fe10 con 0x7f867c0a65f0 2023-09-30T01:57:38.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.606+0000 7f86808b6700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c1500d0 con 0x7f867c0677c0 2023-09-30T01:57:38.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.606+0000 7f867b7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f867c0677c0 0x7f867c14f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:38.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.606+0000 7f867b7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f867c0677c0 0x7f867c14f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:52490/0 (socket says 172.21.15.55:52490) 2023-09-30T01:57:38.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.606+0000 7f867b7fe700 1 -- 172.21.15.55:0/2670931594 learned_addr learned my addr 172.21.15.55:0/2670931594 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:38.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.606+0000 7f867affd700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f867c0a5eb0 0x7f867c144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:38.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.606+0000 7f867bfff700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f867c0a65f0 0x7f867c0b57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:38.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.610+0000 7f867b7fe700 1 -- 172.21.15.55:0/2670931594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f867c0a65f0 msgr2=0x7f867c0b57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:38.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.610+0000 7f867b7fe700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f867c0a65f0 0x7f867c0b57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:38.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.610+0000 7f867b7fe700 1 -- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f867c0a5eb0 msgr2=0x7f867c144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:38.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.610+0000 7f867b7fe700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f867c0a5eb0 0x7f867c144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:38.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.610+0000 7f867b7fe700 1 -- 172.21.15.55:0/2670931594 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8674009a20 con 0x7f867c0677c0 2023-09-30T01:57:38.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.610+0000 7f867affd700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f867c0a5eb0 0x7f867c144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:57:38.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.610+0000 7f867bfff700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f867c0a65f0 0x7f867c0b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:57:38.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.610+0000 7f867b7fe700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f867c0677c0 0x7f867c14f820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f86700011e0 tx=0x7f8670007df0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:38.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.610+0000 7f86637fe700 1 -- 172.21.15.55:0/2670931594 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670005b30 con 0x7f867c0677c0 2023-09-30T01:57:38.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.610+0000 7f86637fe700 1 -- 172.21.15.55:0/2670931594 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8670005c90 con 0x7f867c0677c0 2023-09-30T01:57:38.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.610+0000 7f86808b6700 1 -- 172.21.15.55:0/2670931594 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f867c150390 con 0x7f867c0677c0 2023-09-30T01:57:38.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.610+0000 7f86637fe700 1 -- 172.21.15.55:0/2670931594 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8670007320 con 0x7f867c0677c0 2023-09-30T01:57:38.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.610+0000 7f86808b6700 1 -- 172.21.15.55:0/2670931594 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f867c14d170 con 0x7f867c0677c0 2023-09-30T01:57:38.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.610+0000 7f86808b6700 1 -- 172.21.15.55:0/2670931594 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f867c064440 con 0x7f867c0677c0 2023-09-30T01:57:38.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.614+0000 7f86637fe700 1 -- 172.21.15.55:0/2670931594 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f8670007690 con 0x7f867c0677c0 2023-09-30T01:57:38.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.614+0000 7f86637fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:38.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.614+0000 7f86637fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:38.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.614+0000 7f86637fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:38.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.614+0000 7f86637fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:38.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.614+0000 7f86637fe700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f866808e8b0 0x7f8668090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:38.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.614+0000 7f867affd700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f866808e8b0 0x7f8668090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:38.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.614+0000 7f86637fe700 1 -- 172.21.15.55:0/2670931594 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f86700b3e10 con 0x7f867c0677c0 2023-09-30T01:57:38.620 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.614+0000 7f867affd700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f866808e8b0 0x7f8668090d60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f867c0a4370 tx=0x7f866c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:38.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.622+0000 7f86637fe700 1 -- 172.21.15.55:0/2670931594 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f86700b7030 con 0x7f867c0677c0 2023-09-30T01:57:38.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86808b6700 1 -- 172.21.15.55:0/2670931594 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f867c142dd0 con 0x7f867c0677c0 2023-09-30T01:57:38.825 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86637fe700 1 -- 172.21.15.55:0/2670931594 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f8670017020 con 0x7f867c0677c0 2023-09-30T01:57:38.826 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:38.826 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:38.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86808b6700 10 mgrc shutdown 2023-09-30T01:57:38.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86808b6700 1 -- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f866808e8b0 msgr2=0x7f8668090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:38.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86808b6700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f866808e8b0 0x7f8668090d60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f867c0a4370 tx=0x7f866c009040 comp rx=0 tx=0).stop 2023-09-30T01:57:38.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86808b6700 1 -- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f867c0677c0 msgr2=0x7f867c14f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:38.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86808b6700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f867c0677c0 0x7f867c14f820 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f86700011e0 tx=0x7f8670007df0 comp rx=0 tx=0).stop 2023-09-30T01:57:38.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86808b6700 1 -- 172.21.15.55:0/2670931594 shutdown_connections 2023-09-30T01:57:38.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86808b6700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f867c0a65f0 0x7f867c0b57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:38.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86808b6700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f867c0a5eb0 0x7f867c144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:38.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86808b6700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f866808e8b0 0x7f8668090d60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:38.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86808b6700 1 --2- 172.21.15.55:0/2670931594 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f867c0677c0 0x7f867c14f820 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:38.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86808b6700 1 -- 172.21.15.55:0/2670931594 >> 172.21.15.55:0/2670931594 conn(0x7f867c068820 msgr2=0x7f867c13d880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:38.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86808b6700 1 -- 172.21.15.55:0/2670931594 shutdown_connections 2023-09-30T01:57:38.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:38.822+0000 7f86808b6700 1 -- 172.21.15.55:0/2670931594 wait complete. 2023-09-30T01:57:41.841 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:41.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e99ee700 1 Processor -- start 2023-09-30T01:57:41.958 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e99ee700 1 -- start start 2023-09-30T01:57:41.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e99ee700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86e4135dd0 0x7f86e41361d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:41.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e99ee700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f86e409f930 0x7f86e409fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:41.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e99ee700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86e40a4f90 con 0x7f86e40a4bc0 2023-09-30T01:57:41.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e99ee700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e4136710 con 0x7f86e4135dd0 2023-09-30T01:57:41.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e99ee700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86e40a0810 con 0x7f86e409f930 2023-09-30T01:57:41.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e3fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f86e4135dd0 0x7f86e41361d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:41.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e89ec700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f86e40a4bc0 0x7f86e406b590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35218/0 (socket says 172.21.15.55:35218) 2023-09-30T01:57:41.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e89ec700 1 -- 172.21.15.55:0/3182315927 learned_addr learned my addr 172.21.15.55:0/3182315927 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:57:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e91ed700 1 --2- 172.21.15.55:0/3182315927 >> v2:172.21.15.133:3300/0 conn(0x7f86e409f930 0x7f86e409fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e3fff700 1 -- 172.21.15.55:0/3182315927 >> v2:172.21.15.133:3300/0 conn(0x7f86e409f930 msgr2=0x7f86e409fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:57:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e3fff700 1 --2- 172.21.15.55:0/3182315927 >> v2:172.21.15.133:3300/0 conn(0x7f86e409f930 0x7f86e409fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e3fff700 1 -- 172.21.15.55:0/3182315927 >> v1:172.21.15.55:6789/0 conn(0x7f86e40a4bc0 legacy=0x7f86e406b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e37fe700 1 -- 172.21.15.55:0/3182315927 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2570557548 0 0) 0x7f86e40a4f90 con 0x7f86e40a4bc0 2023-09-30T01:57:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e3fff700 1 -- 172.21.15.55:0/3182315927 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e40a0ad0 con 0x7f86e4135dd0 2023-09-30T01:57:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e91ed700 1 --2- 172.21.15.55:0/3182315927 >> v2:172.21.15.133:3300/0 conn(0x7f86e409f930 0x7f86e409fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:57:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e3fff700 1 --2- 172.21.15.55:0/3182315927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e4135dd0 0x7f86e41361d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f86e406e300 tx=0x7f86d4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=529ecb0fa3d0fc53 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e37fe700 1 -- 172.21.15.55:0/3182315927 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d400e070 con 0x7f86e4135dd0 2023-09-30T01:57:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e37fe700 1 -- 172.21.15.55:0/3182315927 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d400bc30 con 0x7f86e4135dd0 2023-09-30T01:57:41.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e37fe700 1 -- 172.21.15.55:0/3182315927 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d4012430 con 0x7f86e4135dd0 2023-09-30T01:57:41.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e99ee700 1 -- 172.21.15.55:0/3182315927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e4135dd0 msgr2=0x7f86e41361d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:41.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e99ee700 1 --2- 172.21.15.55:0/3182315927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e4135dd0 0x7f86e41361d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f86e406e300 tx=0x7f86d4009780 comp rx=0 tx=0).stop 2023-09-30T01:57:41.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e99ee700 1 -- 172.21.15.55:0/3182315927 shutdown_connections 2023-09-30T01:57:41.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e99ee700 1 --2- 172.21.15.55:0/3182315927 >> v2:172.21.15.133:3300/0 conn(0x7f86e409f930 0x7f86e409fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:41.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.954+0000 7f86e99ee700 1 --2- 172.21.15.55:0/3182315927 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e4135dd0 0x7f86e41361d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:41.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.958+0000 7f86e99ee700 1 -- 172.21.15.55:0/3182315927 >> 172.21.15.55:0/3182315927 conn(0x7f86e40b23d0 msgr2=0x7f86e40b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:41.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.958+0000 7f86e99ee700 1 -- 172.21.15.55:0/3182315927 shutdown_connections 2023-09-30T01:57:41.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.958+0000 7f86e99ee700 1 -- 172.21.15.55:0/3182315927 wait complete. 2023-09-30T01:57:41.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.958+0000 7f86e99ee700 1 Processor -- start 2023-09-30T01:57:41.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.958+0000 7f86e99ee700 1 -- start start 2023-09-30T01:57:41.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e99ee700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e409f930 0x7f86e4138460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:41.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e99ee700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f86e40a4bc0 0x7f86e4153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:41.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e99ee700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86e4135dd0 0x7f86e4153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:41.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e99ee700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4154280 con 0x7f86e409f930 2023-09-30T01:57:41.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e99ee700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86e4137b30 con 0x7f86e4135dd0 2023-09-30T01:57:41.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e99ee700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86e41389a0 con 0x7f86e40a4bc0 2023-09-30T01:57:41.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e89ec700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e409f930 0x7f86e4138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:41.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e89ec700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e409f930 0x7f86e4138460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59322/0 (socket says 172.21.15.55:59322) 2023-09-30T01:57:41.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e89ec700 1 -- 172.21.15.55:0/3798353819 learned_addr learned my addr 172.21.15.55:0/3798353819 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:41.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e3fff700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f86e40a4bc0 0x7f86e4153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:41.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e91ed700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86e4135dd0 0x7f86e4153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:41.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e89ec700 1 -- 172.21.15.55:0/3798353819 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f86e40a4bc0 msgr2=0x7f86e4153800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:41.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e89ec700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f86e40a4bc0 0x7f86e4153800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:41.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e89ec700 1 -- 172.21.15.55:0/3798353819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86e4135dd0 msgr2=0x7f86e4153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:41.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e89ec700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86e4135dd0 0x7f86e4153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:41.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e89ec700 1 -- 172.21.15.55:0/3798353819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86d4009a20 con 0x7f86e409f930 2023-09-30T01:57:41.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e91ed700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86e4135dd0 0x7f86e4153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:57:41.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e89ec700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e409f930 0x7f86e4138460 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86d800c810 tx=0x7f86d8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:41.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e0ff9700 1 -- 172.21.15.55:0/3798353819 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d8005b30 con 0x7f86e409f930 2023-09-30T01:57:41.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e0ff9700 1 -- 172.21.15.55:0/3798353819 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86d8005c90 con 0x7f86e409f930 2023-09-30T01:57:41.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e99ee700 1 -- 172.21.15.55:0/3798353819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e41533b0 con 0x7f86e409f930 2023-09-30T01:57:41.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e0ff9700 1 -- 172.21.15.55:0/3798353819 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86d80072e0 con 0x7f86e409f930 2023-09-30T01:57:41.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e99ee700 1 -- 172.21.15.55:0/3798353819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86e41374d0 con 0x7f86e409f930 2023-09-30T01:57:41.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.962+0000 7f86e99ee700 1 -- 172.21.15.55:0/3798353819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86e4064440 con 0x7f86e409f930 2023-09-30T01:57:41.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.966+0000 7f86e0ff9700 1 -- 172.21.15.55:0/3798353819 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f86d80076d0 con 0x7f86e409f930 2023-09-30T01:57:41.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.966+0000 7f86e0ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:41.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.966+0000 7f86e0ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:41.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.966+0000 7f86e0ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:41.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.966+0000 7f86e0ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:41.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.966+0000 7f86e0ff9700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f86d008e8b0 0x7f86d0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:41.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.966+0000 7f86e3fff700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f86d008e8b0 0x7f86d0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:41.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.966+0000 7f86e0ff9700 1 -- 172.21.15.55:0/3798353819 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f86d80b3d90 con 0x7f86e409f930 2023-09-30T01:57:41.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.966+0000 7f86e3fff700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f86d008e8b0 0x7f86d0090d60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f86e406e300 tx=0x7f86d4019000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:41.982 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:41.978+0000 7f86e0ff9700 1 -- 172.21.15.55:0/3798353819 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f86d8049be0 con 0x7f86e409f930 2023-09-30T01:57:42.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.170+0000 7f86e99ee700 1 -- 172.21.15.55:0/3798353819 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f86e40a02a0 con 0x7f86e409f930 2023-09-30T01:57:42.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.170+0000 7f86e0ff9700 1 -- 172.21.15.55:0/3798353819 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f86d8017100 con 0x7f86e409f930 2023-09-30T01:57:42.176 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:42.176 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:42.178 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.174+0000 7f86e99ee700 10 mgrc shutdown 2023-09-30T01:57:42.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.174+0000 7f86e99ee700 1 -- 172.21.15.55:0/3798353819 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f86d008e8b0 msgr2=0x7f86d0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:42.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.174+0000 7f86e99ee700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f86d008e8b0 0x7f86d0090d60 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f86e406e300 tx=0x7f86d4019000 comp rx=0 tx=0).stop 2023-09-30T01:57:42.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.174+0000 7f86e99ee700 1 -- 172.21.15.55:0/3798353819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e409f930 msgr2=0x7f86e4138460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:42.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.174+0000 7f86e99ee700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e409f930 0x7f86e4138460 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f86d800c810 tx=0x7f86d8007df0 comp rx=0 tx=0).stop 2023-09-30T01:57:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.174+0000 7f86e99ee700 1 -- 172.21.15.55:0/3798353819 shutdown_connections 2023-09-30T01:57:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.174+0000 7f86e99ee700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f86e4135dd0 0x7f86e4153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.174+0000 7f86e99ee700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f86d008e8b0 0x7f86d0090d60 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.174+0000 7f86e99ee700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f86e40a4bc0 0x7f86e4153800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.174+0000 7f86e99ee700 1 --2- 172.21.15.55:0/3798353819 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f86e409f930 0x7f86e4138460 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.174+0000 7f86e99ee700 1 -- 172.21.15.55:0/3798353819 >> 172.21.15.55:0/3798353819 conn(0x7f86e40b23d0 msgr2=0x7f86e40a2880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.174+0000 7f86e99ee700 1 -- 172.21.15.55:0/3798353819 shutdown_connections 2023-09-30T01:57:42.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:42.174+0000 7f86e99ee700 1 -- 172.21.15.55:0/3798353819 wait complete. 2023-09-30T01:57:43.943 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:57:43.946 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:57:45.192 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:45.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.302+0000 7fba11fce700 1 Processor -- start 2023-09-30T01:57:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.302+0000 7fba11fce700 1 -- start start 2023-09-30T01:57:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba11fce700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba0c0679e0 0x7fba0c13d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba11fce700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fba0c0a5e80 0x7fba0c0a6250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba11fce700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba0c067db0 con 0x7fba0c06cda0 2023-09-30T01:57:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba11fce700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba0c0a6e80 con 0x7fba0c0a5e80 2023-09-30T01:57:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba11fce700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c1416b0 con 0x7fba0c0679e0 2023-09-30T01:57:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba117cd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fba0c06cda0 0x7fba0c06d1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35230/0 (socket says 172.21.15.55:35230) 2023-09-30T01:57:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba10fcc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba0c0679e0 0x7fba0c13d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:45.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba117cd700 1 -- 172.21.15.55:0/1787299241 learned_addr learned my addr 172.21.15.55:0/1787299241 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:57:45.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba0bfff700 1 --2- 172.21.15.55:0/1787299241 >> v2:172.21.15.133:3300/0 conn(0x7fba0c0a5e80 0x7fba0c0a6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:45.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba10fcc700 1 -- 172.21.15.55:0/1787299241 >> v2:172.21.15.133:3300/0 conn(0x7fba0c0a5e80 msgr2=0x7fba0c0a6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:57:45.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba10fcc700 1 --2- 172.21.15.55:0/1787299241 >> v2:172.21.15.133:3300/0 conn(0x7fba0c0a5e80 0x7fba0c0a6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:45.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba0b7fe700 1 -- 172.21.15.55:0/1787299241 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2322117343 0 0) 0x7fba0c067db0 con 0x7fba0c06cda0 2023-09-30T01:57:45.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba10fcc700 1 -- 172.21.15.55:0/1787299241 >> v1:172.21.15.55:6789/0 conn(0x7fba0c06cda0 legacy=0x7fba0c06d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:45.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba10fcc700 1 -- 172.21.15.55:0/1787299241 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba0c141950 con 0x7fba0c0679e0 2023-09-30T01:57:45.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba10fcc700 1 --2- 172.21.15.55:0/1787299241 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba0c0679e0 0x7fba0c13d770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0098e0 tx=0x7fb9fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b7e475e31066b15 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:45.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba0b7fe700 1 -- 172.21.15.55:0/1787299241 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc009e80 con 0x7fba0c0679e0 2023-09-30T01:57:45.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba0b7fe700 1 -- 172.21.15.55:0/1787299241 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc00b8f0 con 0x7fba0c0679e0 2023-09-30T01:57:45.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba0b7fe700 1 -- 172.21.15.55:0/1787299241 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00bc70 con 0x7fba0c0679e0 2023-09-30T01:57:45.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba11fce700 1 -- 172.21.15.55:0/1787299241 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba0c0679e0 msgr2=0x7fba0c13d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:45.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba11fce700 1 --2- 172.21.15.55:0/1787299241 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba0c0679e0 0x7fba0c13d770 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc0098e0 tx=0x7fb9fc0091a0 comp rx=0 tx=0).stop 2023-09-30T01:57:45.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba11fce700 1 -- 172.21.15.55:0/1787299241 shutdown_connections 2023-09-30T01:57:45.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba11fce700 1 --2- 172.21.15.55:0/1787299241 >> v2:172.21.15.133:3300/0 conn(0x7fba0c0a5e80 0x7fba0c0a6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:45.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba11fce700 1 --2- 172.21.15.55:0/1787299241 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba0c0679e0 0x7fba0c13d770 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:45.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba11fce700 1 -- 172.21.15.55:0/1787299241 >> 172.21.15.55:0/1787299241 conn(0x7fba0c06ff20 msgr2=0x7fba0c0670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:45.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba11fce700 1 -- 172.21.15.55:0/1787299241 shutdown_connections 2023-09-30T01:57:45.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.306+0000 7fba11fce700 1 -- 172.21.15.55:0/1787299241 wait complete. 2023-09-30T01:57:45.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba11fce700 1 Processor -- start 2023-09-30T01:57:45.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba11fce700 1 -- start start 2023-09-30T01:57:45.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba11fce700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba0c0679e0 0x7fba0c11cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:45.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba11fce700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c06cda0 0x7fba0c0b0c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:45.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba11fce700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba0c0a5e80 0x7fba0c13cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:45.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba11fce700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c0aebc0 con 0x7fba0c06cda0 2023-09-30T01:57:45.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba11fce700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c13d4e0 con 0x7fba0c0679e0 2023-09-30T01:57:45.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba11fce700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba0c11d250 con 0x7fba0c0a5e80 2023-09-30T01:57:45.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba117cd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba0c0a5e80 0x7fba0c13cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:45.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba0bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c06cda0 0x7fba0c0b0c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:45.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba10fcc700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba0c0679e0 0x7fba0c11cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:45.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba117cd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba0c0a5e80 0x7fba0c13cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:52478/0 (socket says 172.21.15.55:52478) 2023-09-30T01:57:45.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba117cd700 1 -- 172.21.15.55:0/737730858 learned_addr learned my addr 172.21.15.55:0/737730858 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:45.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba10fcc700 1 -- 172.21.15.55:0/737730858 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba0c0a5e80 msgr2=0x7fba0c13cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:45.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba10fcc700 1 --2- 172.21.15.55:0/737730858 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba0c0a5e80 0x7fba0c13cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:45.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba10fcc700 1 -- 172.21.15.55:0/737730858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c06cda0 msgr2=0x7fba0c0b0c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:45.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba10fcc700 1 --2- 172.21.15.55:0/737730858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c06cda0 0x7fba0c0b0c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:45.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba10fcc700 1 -- 172.21.15.55:0/737730858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9fc009420 con 0x7fba0c0679e0 2023-09-30T01:57:45.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba10fcc700 1 --2- 172.21.15.55:0/737730858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba0c0679e0 0x7fba0c11cd10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc016000 tx=0x7fb9fc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:45.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.310+0000 7fba08ff9700 1 -- 172.21.15.55:0/737730858 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc00bc70 con 0x7fba0c0679e0 2023-09-30T01:57:45.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.314+0000 7fba08ff9700 1 -- 172.21.15.55:0/737730858 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9fc011420 con 0x7fba0c0679e0 2023-09-30T01:57:45.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.314+0000 7fba11fce700 1 -- 172.21.15.55:0/737730858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba0c0af7a0 con 0x7fba0c0679e0 2023-09-30T01:57:45.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.314+0000 7fba08ff9700 1 -- 172.21.15.55:0/737730858 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9fc0117c0 con 0x7fba0c0679e0 2023-09-30T01:57:45.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.314+0000 7fba11fce700 1 -- 172.21.15.55:0/737730858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba0c0b11d0 con 0x7fba0c0679e0 2023-09-30T01:57:45.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.314+0000 7fba11fce700 1 -- 172.21.15.55:0/737730858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba0c064440 con 0x7fba0c0679e0 2023-09-30T01:57:45.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.314+0000 7fba08ff9700 1 -- 172.21.15.55:0/737730858 <== mon.1 v2:172.21.15.133:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fb9fc011b70 con 0x7fba0c0679e0 2023-09-30T01:57:45.323 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.314+0000 7fba08ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.318+0000 7fba08ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.318+0000 7fba08ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.318+0000 7fba08ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.318+0000 7fba08ff9700 1 --2- 172.21.15.55:0/737730858 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb9f808e8e0 0x7fb9f8090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.318+0000 7fba0bfff700 1 --2- 172.21.15.55:0/737730858 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb9f808e8e0 0x7fb9f8090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.318+0000 7fba08ff9700 1 -- 172.21.15.55:0/737730858 <== mon.1 v2:172.21.15.133:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fb9fc0b6020 con 0x7fba0c0679e0 2023-09-30T01:57:45.324 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.318+0000 7fba0bfff700 1 --2- 172.21.15.55:0/737730858 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb9f808e8e0 0x7fb9f8090d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fba0c13dbc0 tx=0x7fba00008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:45.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.326+0000 7fba08ff9700 1 -- 172.21.15.55:0/737730858 <== mon.1 v2:172.21.15.133:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb9fc086a50 con 0x7fba0c0679e0 2023-09-30T01:57:45.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.522+0000 7fba11fce700 1 -- 172.21.15.55:0/737730858 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fba0c0a8580 con 0x7fba0c0679e0 2023-09-30T01:57:45.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.522+0000 7fba08ff9700 1 -- 172.21.15.55:0/737730858 <== mon.1 v2:172.21.15.133:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fb9fc08a070 con 0x7fba0c0679e0 2023-09-30T01:57:45.529 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:45.529 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:45.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.526+0000 7fba11fce700 10 mgrc shutdown 2023-09-30T01:57:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.526+0000 7fba11fce700 1 -- 172.21.15.55:0/737730858 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb9f808e8e0 msgr2=0x7fb9f8090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.526+0000 7fba11fce700 1 --2- 172.21.15.55:0/737730858 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb9f808e8e0 0x7fb9f8090d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fba0c13dbc0 tx=0x7fba00008040 comp rx=0 tx=0).stop 2023-09-30T01:57:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.526+0000 7fba11fce700 1 -- 172.21.15.55:0/737730858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba0c0679e0 msgr2=0x7fba0c11cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.526+0000 7fba11fce700 1 --2- 172.21.15.55:0/737730858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba0c0679e0 0x7fba0c11cd10 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb9fc016000 tx=0x7fb9fc017000 comp rx=0 tx=0).stop 2023-09-30T01:57:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.526+0000 7fba11fce700 1 -- 172.21.15.55:0/737730858 shutdown_connections 2023-09-30T01:57:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.526+0000 7fba11fce700 1 --2- 172.21.15.55:0/737730858 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb9f808e8e0 0x7fb9f8090d90 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.526+0000 7fba11fce700 1 --2- 172.21.15.55:0/737730858 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fba0c0a5e80 0x7fba0c13cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:45.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.526+0000 7fba11fce700 1 --2- 172.21.15.55:0/737730858 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fba0c06cda0 0x7fba0c0b0c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.526+0000 7fba11fce700 1 --2- 172.21.15.55:0/737730858 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fba0c0679e0 0x7fba0c11cd10 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.526+0000 7fba11fce700 1 -- 172.21.15.55:0/737730858 >> 172.21.15.55:0/737730858 conn(0x7fba0c06ff20 msgr2=0x7fba0c13e900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.526+0000 7fba11fce700 1 -- 172.21.15.55:0/737730858 shutdown_connections 2023-09-30T01:57:45.533 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:45.526+0000 7fba11fce700 1 -- 172.21.15.55:0/737730858 wait complete. 2023-09-30T01:57:48.544 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:48.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc66bca5700 1 Processor -- start 2023-09-30T01:57:48.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc66bca5700 1 -- start start 2023-09-30T01:57:48.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc66bca5700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6640a7f20 0x7fc66413ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc66bca5700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640b3430 con 0x7fc6640b3060 2023-09-30T01:57:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc66bca5700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6640a4b60 con 0x7fc66413e5f0 2023-09-30T01:57:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc66bca5700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66413b8f0 con 0x7fc6640a7f20 2023-09-30T01:57:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc66a242700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6640a7f20 0x7fc66413ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc66a242700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6640a7f20 0x7fc66413ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:52480/0 (socket says 172.21.15.55:52480) 2023-09-30T01:57:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc66a242700 1 -- 172.21.15.55:0/1528132549 learned_addr learned my addr 172.21.15.55:0/1528132549 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc669a41700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc6640b3060 0x7fc6640a6120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:35234/0 (socket says 172.21.15.55:35234) 2023-09-30T01:57:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc66a242700 1 -- 172.21.15.55:0/1528132549 >> v1:172.21.15.133:6789/0 conn(0x7fc66413e5f0 legacy=0x7fc6640a7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc66a242700 1 -- 172.21.15.55:0/1528132549 >> v1:172.21.15.55:6789/0 conn(0x7fc6640b3060 legacy=0x7fc6640a6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:48.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc66a242700 1 -- 172.21.15.55:0/1528132549 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66413dfa0 con 0x7fc6640a7f20 2023-09-30T01:57:48.662 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc66a242700 1 --2- 172.21.15.55:0/1528132549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6640a7f20 0x7fc66413ea10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009f50 tx=0x7fc65c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0f80a32f4ee82fe server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:48.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.654+0000 7fc668a3f700 1 -- 172.21.15.55:0/1528132549 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c00e070 con 0x7fc6640a7f20 2023-09-30T01:57:48.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc668a3f700 1 -- 172.21.15.55:0/1528132549 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65c00bab0 con 0x7fc6640a7f20 2023-09-30T01:57:48.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc668a3f700 1 -- 172.21.15.55:0/1528132549 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0092e0 con 0x7fc6640a7f20 2023-09-30T01:57:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 -- 172.21.15.55:0/1528132549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6640a7f20 msgr2=0x7fc66413ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 --2- 172.21.15.55:0/1528132549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6640a7f20 0x7fc66413ea10 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009f50 tx=0x7fc65c009840 comp rx=0 tx=0).stop 2023-09-30T01:57:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 -- 172.21.15.55:0/1528132549 shutdown_connections 2023-09-30T01:57:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 --2- 172.21.15.55:0/1528132549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6640a7f20 0x7fc66413ea10 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 -- 172.21.15.55:0/1528132549 >> 172.21.15.55:0/1528132549 conn(0x7fc664068b00 msgr2=0x7fc6640b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 -- 172.21.15.55:0/1528132549 shutdown_connections 2023-09-30T01:57:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 -- 172.21.15.55:0/1528132549 wait complete. 2023-09-30T01:57:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 Processor -- start 2023-09-30T01:57:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 -- start start 2023-09-30T01:57:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6640a7f20 0x7fc664144ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:48.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6640b3060 0x7fc664142710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc66413e5f0 0x7fc6641434c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc664145930 con 0x7fc66413e5f0 2023-09-30T01:57:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6641363a0 con 0x7fc6640b3060 2023-09-30T01:57:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66bca5700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc664143200 con 0x7fc6640a7f20 2023-09-30T01:57:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc669a41700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6640a7f20 0x7fc664144ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66a242700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc66413e5f0 0x7fc6641434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc669a41700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6640a7f20 0x7fc664144ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:52496/0 (socket says 172.21.15.55:52496) 2023-09-30T01:57:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66a242700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc66413e5f0 0x7fc6641434c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59344/0 (socket says 172.21.15.55:59344) 2023-09-30T01:57:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc669a41700 1 -- 172.21.15.55:0/3816178160 learned_addr learned my addr 172.21.15.55:0/3816178160 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc669240700 1 --2- 172.21.15.55:0/3816178160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6640b3060 0x7fc664142710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:48.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66a242700 1 -- 172.21.15.55:0/3816178160 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6640a7f20 msgr2=0x7fc664144ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:48.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66a242700 1 --2- 172.21.15.55:0/3816178160 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6640a7f20 0x7fc664144ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:48.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66a242700 1 -- 172.21.15.55:0/3816178160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6640b3060 msgr2=0x7fc664142710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:48.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66a242700 1 --2- 172.21.15.55:0/3816178160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6640b3060 0x7fc664142710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:48.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66a242700 1 -- 172.21.15.55:0/3816178160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c009ae0 con 0x7fc66413e5f0 2023-09-30T01:57:48.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc669a41700 1 --2- 172.21.15.55:0/3816178160 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6640a7f20 0x7fc664144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:57:48.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.658+0000 7fc66a242700 1 --2- 172.21.15.55:0/3816178160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc66413e5f0 0x7fc6641434c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc65c015000 tx=0x7fc65c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:48.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.662+0000 7fc659ffb700 1 -- 172.21.15.55:0/3816178160 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c0032f0 con 0x7fc66413e5f0 2023-09-30T01:57:48.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.662+0000 7fc659ffb700 1 -- 172.21.15.55:0/3816178160 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65c008d20 con 0x7fc66413e5f0 2023-09-30T01:57:48.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.662+0000 7fc66bca5700 1 -- 172.21.15.55:0/3816178160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6641453e0 con 0x7fc66413e5f0 2023-09-30T01:57:48.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.662+0000 7fc659ffb700 1 -- 172.21.15.55:0/3816178160 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c026690 con 0x7fc66413e5f0 2023-09-30T01:57:48.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.662+0000 7fc66bca5700 1 -- 172.21.15.55:0/3816178160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc664139490 con 0x7fc66413e5f0 2023-09-30T01:57:48.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.662+0000 7fc66bca5700 1 -- 172.21.15.55:0/3816178160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66413b3f0 con 0x7fc66413e5f0 2023-09-30T01:57:48.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.666+0000 7fc659ffb700 1 -- 172.21.15.55:0/3816178160 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc65c003040 con 0x7fc66413e5f0 2023-09-30T01:57:48.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.666+0000 7fc659ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:48.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.666+0000 7fc659ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:48.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.666+0000 7fc659ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:48.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.666+0000 7fc659ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:48.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.666+0000 7fc659ffb700 1 --2- 172.21.15.55:0/3816178160 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc64808e8b0 0x7fc648090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:48.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.666+0000 7fc659ffb700 1 -- 172.21.15.55:0/3816178160 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fc65c0b68c0 con 0x7fc66413e5f0 2023-09-30T01:57:48.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.666+0000 7fc669a41700 1 --2- 172.21.15.55:0/3816178160 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc64808e8b0 0x7fc648090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:48.672 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.666+0000 7fc669a41700 1 --2- 172.21.15.55:0/3816178160 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc64808e8b0 0x7fc648090d60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc654004900 tx=0x7fc654007f70 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:48.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.670+0000 7fc659ffb700 1 -- 172.21.15.55:0/3816178160 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc65c0872f0 con 0x7fc66413e5f0 2023-09-30T01:57:48.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.866+0000 7fc66bca5700 1 -- 172.21.15.55:0/3816178160 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc66413b3f0 con 0x7fc66413e5f0 2023-09-30T01:57:48.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.866+0000 7fc659ffb700 1 -- 172.21.15.55:0/3816178160 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fc66413b3f0 con 0x7fc66413e5f0 2023-09-30T01:57:48.872 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:48.872 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:48.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.870+0000 7fc66bca5700 10 mgrc shutdown 2023-09-30T01:57:48.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.870+0000 7fc66bca5700 1 -- 172.21.15.55:0/3816178160 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc64808e8b0 msgr2=0x7fc648090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:48.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.870+0000 7fc66bca5700 1 --2- 172.21.15.55:0/3816178160 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc64808e8b0 0x7fc648090d60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fc654004900 tx=0x7fc654007f70 comp rx=0 tx=0).stop 2023-09-30T01:57:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.870+0000 7fc66bca5700 1 -- 172.21.15.55:0/3816178160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc66413e5f0 msgr2=0x7fc6641434c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.870+0000 7fc66bca5700 1 --2- 172.21.15.55:0/3816178160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc66413e5f0 0x7fc6641434c0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc65c015000 tx=0x7fc65c018000 comp rx=0 tx=0).stop 2023-09-30T01:57:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.870+0000 7fc66bca5700 1 -- 172.21.15.55:0/3816178160 shutdown_connections 2023-09-30T01:57:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.870+0000 7fc66bca5700 1 --2- 172.21.15.55:0/3816178160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc66413e5f0 0x7fc6641434c0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.870+0000 7fc66bca5700 1 --2- 172.21.15.55:0/3816178160 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc6640b3060 0x7fc664142710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.870+0000 7fc66bca5700 1 --2- 172.21.15.55:0/3816178160 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc64808e8b0 0x7fc648090d60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.870+0000 7fc66bca5700 1 --2- 172.21.15.55:0/3816178160 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc6640a7f20 0x7fc664144ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.870+0000 7fc66bca5700 1 -- 172.21.15.55:0/3816178160 >> 172.21.15.55:0/3816178160 conn(0x7fc664068b00 msgr2=0x7fc6640677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.870+0000 7fc66bca5700 1 -- 172.21.15.55:0/3816178160 shutdown_connections 2023-09-30T01:57:48.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:48.870+0000 7fc66bca5700 1 -- 172.21.15.55:0/3816178160 wait complete. 2023-09-30T01:57:51.887 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:52.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.994+0000 7f3603fff700 1 Processor -- start 2023-09-30T01:57:52.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.994+0000 7f3603fff700 1 -- start start 2023-09-30T01:57:52.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.994+0000 7f3603fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f360406b5a0 0x7f3604136740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:52.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.994+0000 7f3603fff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3604136c80 con 0x7f36040a9130 2023-09-30T01:57:52.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.994+0000 7f3603fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36040a38e0 con 0x7f36040a4480 2023-09-30T01:57:52.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.994+0000 7f3603fff700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36040a69c0 con 0x7f360406b5a0 2023-09-30T01:57:52.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f36037fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f360406b5a0 0x7f3604136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:52.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f3602ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f36040a9130 0x7f36040a3d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:54670/0 (socket says 172.21.15.55:54670) 2023-09-30T01:57:52.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f3602ffd700 1 -- 172.21.15.55:0/2777491160 learned_addr learned my addr 172.21.15.55:0/2777491160 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:57:52.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f36037fe700 1 -- 172.21.15.55:0/2777491160 >> v1:172.21.15.133:6789/0 conn(0x7f36040a4480 legacy=0x7f3604136030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:57:52.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f36037fe700 1 -- 172.21.15.55:0/2777491160 >> v1:172.21.15.55:6789/0 conn(0x7f36040a9130 legacy=0x7f36040a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:52.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f36037fe700 1 -- 172.21.15.55:0/2777491160 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36040a9500 con 0x7f360406b5a0 2023-09-30T01:57:52.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f36037fe700 1 --2- 172.21.15.55:0/2777491160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f360406b5a0 0x7f3604136740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f35f40098e0 tx=0x7f35f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43ef53309ac129cd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:52.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f3601ffb700 1 -- 172.21.15.55:0/2777491160 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f4009e80 con 0x7f360406b5a0 2023-09-30T01:57:52.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f3601ffb700 1 -- 172.21.15.55:0/2777491160 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f400b820 con 0x7f360406b5a0 2023-09-30T01:57:52.003 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f3601ffb700 1 -- 172.21.15.55:0/2777491160 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f400bba0 con 0x7f360406b5a0 2023-09-30T01:57:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f3603fff700 1 -- 172.21.15.55:0/2777491160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f360406b5a0 msgr2=0x7f3604136740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f3603fff700 1 --2- 172.21.15.55:0/2777491160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f360406b5a0 0x7f3604136740 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f35f40098e0 tx=0x7f35f40091a0 comp rx=0 tx=0).stop 2023-09-30T01:57:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f3603fff700 1 -- 172.21.15.55:0/2777491160 shutdown_connections 2023-09-30T01:57:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f3603fff700 1 --2- 172.21.15.55:0/2777491160 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f360406b5a0 0x7f3604136740 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f3603fff700 1 -- 172.21.15.55:0/2777491160 >> 172.21.15.55:0/2777491160 conn(0x7f36040b6940 msgr2=0x7f36040b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f3603fff700 1 -- 172.21.15.55:0/2777491160 shutdown_connections 2023-09-30T01:57:52.004 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:51.998+0000 7f3603fff700 1 -- 172.21.15.55:0/2777491160 wait complete. 2023-09-30T01:57:52.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f3603fff700 1 Processor -- start 2023-09-30T01:57:52.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f3603fff700 1 -- start start 2023-09-30T01:57:52.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f3603fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f360406b5a0 0x7f36040a01d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:52.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f3603fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36040a4480 0x7f3604152fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:52.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f3603fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36040a9130 0x7f3604153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:52.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f3603fff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36041364e0 con 0x7f36040a4480 2023-09-30T01:57:52.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f3603fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f360409f040 con 0x7f360406b5a0 2023-09-30T01:57:52.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f3603fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f360409f300 con 0x7f36040a9130 2023-09-30T01:57:52.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f36037fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36040a9130 0x7f3604153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:52.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f36027fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36040a4480 0x7f3604152fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:52.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f36037fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36040a9130 0x7f3604153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43084/0 (socket says 172.21.15.55:43084) 2023-09-30T01:57:52.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f36037fe700 1 -- 172.21.15.55:0/1194901423 learned_addr learned my addr 172.21.15.55:0/1194901423 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:52.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f3602ffd700 1 --2- 172.21.15.55:0/1194901423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f360406b5a0 0x7f36040a01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:52.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f36027fc700 1 -- 172.21.15.55:0/1194901423 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36040a9130 msgr2=0x7f3604153500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:52.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f36027fc700 1 --2- 172.21.15.55:0/1194901423 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36040a9130 0x7f3604153500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:52.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f36027fc700 1 -- 172.21.15.55:0/1194901423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f360406b5a0 msgr2=0x7f36040a01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:52.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f36027fc700 1 --2- 172.21.15.55:0/1194901423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f360406b5a0 0x7f36040a01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:52.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f36027fc700 1 -- 172.21.15.55:0/1194901423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f4009420 con 0x7f36040a4480 2023-09-30T01:57:52.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.002+0000 7f3602ffd700 1 --2- 172.21.15.55:0/1194901423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f360406b5a0 0x7f36040a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:57:52.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.006+0000 7f36027fc700 1 --2- 172.21.15.55:0/1194901423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36040a4480 0x7f3604152fc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00c4e0 tx=0x7f35ec007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:52.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.006+0000 7f35faffd700 1 -- 172.21.15.55:0/1194901423 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec00ce90 con 0x7f36040a4480 2023-09-30T01:57:52.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.006+0000 7f35faffd700 1 -- 172.21.15.55:0/1194901423 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35ec011590 con 0x7f36040a4480 2023-09-30T01:57:52.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.006+0000 7f3603fff700 1 -- 172.21.15.55:0/1194901423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f360409f5c0 con 0x7f36040a4480 2023-09-30T01:57:52.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.006+0000 7f35faffd700 1 -- 172.21.15.55:0/1194901423 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35ec011930 con 0x7f36040a4480 2023-09-30T01:57:52.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.006+0000 7f3603fff700 1 -- 172.21.15.55:0/1194901423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36040a08b0 con 0x7f36040a4480 2023-09-30T01:57:52.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.006+0000 7f3603fff700 1 -- 172.21.15.55:0/1194901423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3604064440 con 0x7f36040a4480 2023-09-30T01:57:52.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.010+0000 7f35faffd700 1 -- 172.21.15.55:0/1194901423 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f35ec01c460 con 0x7f36040a4480 2023-09-30T01:57:52.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.010+0000 7f35faffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:52.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.010+0000 7f35faffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:52.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.010+0000 7f35faffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:52.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.010+0000 7f35faffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:52.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.010+0000 7f35faffd700 1 --2- 172.21.15.55:0/1194901423 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f35e408e8b0 0x7f35e4090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:52.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.010+0000 7f3602ffd700 1 --2- 172.21.15.55:0/1194901423 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f35e408e8b0 0x7f35e4090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:52.015 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.010+0000 7f35faffd700 1 -- 172.21.15.55:0/1194901423 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f35ec0b4500 con 0x7f36040a4480 2023-09-30T01:57:52.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.010+0000 7f3602ffd700 1 --2- 172.21.15.55:0/1194901423 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f35e408e8b0 0x7f35e4090d60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0075d0 tx=0x7f35fc001970 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:52.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.018+0000 7f35faffd700 1 -- 172.21.15.55:0/1194901423 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f35ec084e00 con 0x7f36040a4480 2023-09-30T01:57:52.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.214+0000 7f3603fff700 1 -- 172.21.15.55:0/1194901423 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f360406bd60 con 0x7f36040a4480 2023-09-30T01:57:52.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.218+0000 7f35faffd700 1 -- 172.21.15.55:0/1194901423 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f35ec088420 con 0x7f36040a4480 2023-09-30T01:57:52.221 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:52.221 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:52.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.218+0000 7f3603fff700 10 mgrc shutdown 2023-09-30T01:57:52.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.218+0000 7f3603fff700 1 -- 172.21.15.55:0/1194901423 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f35e408e8b0 msgr2=0x7f35e4090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:52.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.218+0000 7f3603fff700 1 --2- 172.21.15.55:0/1194901423 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f35e408e8b0 0x7f35e4090d60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f35fc0075d0 tx=0x7f35fc001970 comp rx=0 tx=0).stop 2023-09-30T01:57:52.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.218+0000 7f3603fff700 1 -- 172.21.15.55:0/1194901423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36040a4480 msgr2=0x7f3604152fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:52.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.218+0000 7f3603fff700 1 --2- 172.21.15.55:0/1194901423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36040a4480 0x7f3604152fc0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f35ec00c4e0 tx=0x7f35ec007ea0 comp rx=0 tx=0).stop 2023-09-30T01:57:52.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.218+0000 7f3603fff700 1 -- 172.21.15.55:0/1194901423 shutdown_connections 2023-09-30T01:57:52.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.218+0000 7f3603fff700 1 --2- 172.21.15.55:0/1194901423 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f35e408e8b0 0x7f35e4090d60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:52.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.218+0000 7f3603fff700 1 --2- 172.21.15.55:0/1194901423 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f36040a9130 0x7f3604153500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:52.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.218+0000 7f3603fff700 1 --2- 172.21.15.55:0/1194901423 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f36040a4480 0x7f3604152fc0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:52.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.218+0000 7f3603fff700 1 --2- 172.21.15.55:0/1194901423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f360406b5a0 0x7f36040a01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:52.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.218+0000 7f3603fff700 1 -- 172.21.15.55:0/1194901423 >> 172.21.15.55:0/1194901423 conn(0x7f36040b6940 msgr2=0x7f36040677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:52.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.218+0000 7f3603fff700 1 -- 172.21.15.55:0/1194901423 shutdown_connections 2023-09-30T01:57:52.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:52.218+0000 7f3603fff700 1 -- 172.21.15.55:0/1194901423 wait complete. 2023-09-30T01:57:55.236 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:55.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f45149af700 1 Processor -- start 2023-09-30T01:57:55.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f45149af700 1 -- start start 2023-09-30T01:57:55.350 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f45149af700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f45100aba80 0x7f45100abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:55.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f45149af700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f451013d5b0 0x7f45100a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:55.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f45149af700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4510140f00 con 0x7f451013d980 2023-09-30T01:57:55.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f45149af700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4510143620 con 0x7f45100aba80 2023-09-30T01:57:55.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f45149af700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45100ac390 con 0x7f451013d5b0 2023-09-30T01:57:55.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f450e59c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f451013d5b0 0x7f45100a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:55.351 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f450e59c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f451013d5b0 0x7f45100a5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43090/0 (socket says 172.21.15.55:43090) 2023-09-30T01:57:55.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f450e59c700 1 -- 172.21.15.55:0/2361450618 learned_addr learned my addr 172.21.15.55:0/2361450618 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:55.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f450ed9d700 1 --2- 172.21.15.55:0/2361450618 >> v2:172.21.15.133:3300/0 conn(0x7f45100aba80 0x7f45100abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:55.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f450e59c700 1 -- 172.21.15.55:0/2361450618 >> v2:172.21.15.133:3300/0 conn(0x7f45100aba80 msgr2=0x7f45100abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:57:55.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f450dd9b700 1 -- 172.21.15.55:0/2361450618 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3882034999 0 0) 0x7f4510140f00 con 0x7f451013d980 2023-09-30T01:57:55.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f450e59c700 1 --2- 172.21.15.55:0/2361450618 >> v2:172.21.15.133:3300/0 conn(0x7f45100aba80 0x7f45100abe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:55.352 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f450e59c700 1 -- 172.21.15.55:0/2361450618 >> v1:172.21.15.55:6789/0 conn(0x7f451013d980 legacy=0x7f4510140290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:55.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f450e59c700 1 -- 172.21.15.55:0/2361450618 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45100a64e0 con 0x7f451013d5b0 2023-09-30T01:57:55.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f450e59c700 1 --2- 172.21.15.55:0/2361450618 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f451013d5b0 0x7f45100a5fa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f44f80099b0 tx=0x7f44f8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f5470b124147e22 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:55.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f450dd9b700 1 -- 172.21.15.55:0/2361450618 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f8009ea0 con 0x7f451013d5b0 2023-09-30T01:57:55.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f450dd9b700 1 -- 172.21.15.55:0/2361450618 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44f800b860 con 0x7f451013d5b0 2023-09-30T01:57:55.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.346+0000 7f450dd9b700 1 -- 172.21.15.55:0/2361450618 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44f800bc00 con 0x7f451013d5b0 2023-09-30T01:57:55.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 -- 172.21.15.55:0/2361450618 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f451013d5b0 msgr2=0x7f45100a5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:55.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 --2- 172.21.15.55:0/2361450618 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f451013d5b0 0x7f45100a5fa0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f44f80099b0 tx=0x7f44f8009250 comp rx=0 tx=0).stop 2023-09-30T01:57:55.354 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 -- 172.21.15.55:0/2361450618 shutdown_connections 2023-09-30T01:57:55.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 --2- 172.21.15.55:0/2361450618 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f451013d5b0 0x7f45100a5fa0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:55.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 --2- 172.21.15.55:0/2361450618 >> v2:172.21.15.133:3300/0 conn(0x7f45100aba80 0x7f45100abe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:55.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 -- 172.21.15.55:0/2361450618 >> 172.21.15.55:0/2361450618 conn(0x7f45100681b0 msgr2=0x7f45100685b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:55.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 -- 172.21.15.55:0/2361450618 shutdown_connections 2023-09-30T01:57:55.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 -- 172.21.15.55:0/2361450618 wait complete. 2023-09-30T01:57:55.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 Processor -- start 2023-09-30T01:57:55.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 -- start start 2023-09-30T01:57:55.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45100aba80 0x7f4510142e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:55.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451013d5b0 0x7f4510153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:55.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f451013d980 0x7f45101537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:55.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100b11a0 con 0x7f451013d5b0 2023-09-30T01:57:55.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45100b1630 con 0x7f45100aba80 2023-09-30T01:57:55.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f45149af700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4510153df0 con 0x7f451013d980 2023-09-30T01:57:55.360 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f450f59e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f451013d980 0x7f45101537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f450f59e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f451013d980 0x7f45101537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43104/0 (socket says 172.21.15.55:43104) 2023-09-30T01:57:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f450e59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451013d5b0 0x7f4510153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f450f59e700 1 -- 172.21.15.55:0/3806013363 learned_addr learned my addr 172.21.15.55:0/3806013363 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.350+0000 7f450ed9d700 1 --2- 172.21.15.55:0/3806013363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45100aba80 0x7f4510142e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f450f59e700 1 -- 172.21.15.55:0/3806013363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45100aba80 msgr2=0x7f4510142e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f450f59e700 1 --2- 172.21.15.55:0/3806013363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45100aba80 0x7f4510142e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f450f59e700 1 -- 172.21.15.55:0/3806013363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451013d5b0 msgr2=0x7f4510153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f450f59e700 1 --2- 172.21.15.55:0/3806013363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451013d5b0 0x7f4510153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f450f59e700 1 -- 172.21.15.55:0/3806013363 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f80094f0 con 0x7f451013d980 2023-09-30T01:57:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f450ed9d700 1 --2- 172.21.15.55:0/3806013363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45100aba80 0x7f4510142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:57:55.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f450f59e700 1 --2- 172.21.15.55:0/3806013363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f451013d980 0x7f45101537d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f450800c4f0 tx=0x7f4508007f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:55.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f4506ffd700 1 -- 172.21.15.55:0/3806013363 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508011590 con 0x7f451013d980 2023-09-30T01:57:55.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f4506ffd700 1 -- 172.21.15.55:0/3806013363 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45080116f0 con 0x7f451013d980 2023-09-30T01:57:55.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f4506ffd700 1 -- 172.21.15.55:0/3806013363 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4508011ab0 con 0x7f451013d980 2023-09-30T01:57:55.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f45149af700 1 -- 172.21.15.55:0/3806013363 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45101540b0 con 0x7f451013d980 2023-09-30T01:57:55.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f45149af700 1 -- 172.21.15.55:0/3806013363 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45100aee30 con 0x7f451013d980 2023-09-30T01:57:55.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f45149af700 1 -- 172.21.15.55:0/3806013363 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45100b1310 con 0x7f451013d980 2023-09-30T01:57:55.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f4506ffd700 1 -- 172.21.15.55:0/3806013363 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f450801b3b0 con 0x7f451013d980 2023-09-30T01:57:55.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.354+0000 7f4506ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:55.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.358+0000 7f4506ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:55.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.358+0000 7f4506ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:55.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.358+0000 7f4506ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:55.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.358+0000 7f4506ffd700 1 --2- 172.21.15.55:0/3806013363 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f44f008e8b0 0x7f44f0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:55.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.358+0000 7f4506ffd700 1 -- 172.21.15.55:0/3806013363 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f45080b3c90 con 0x7f451013d980 2023-09-30T01:57:55.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.358+0000 7f450ed9d700 1 --2- 172.21.15.55:0/3806013363 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f44f008e8b0 0x7f44f0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:55.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.358+0000 7f450ed9d700 1 --2- 172.21.15.55:0/3806013363 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f44f008e8b0 0x7f44f0090d60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f45000076c0 tx=0x7f450000b040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:55.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.362+0000 7f4506ffd700 1 -- 172.21.15.55:0/3806013363 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4508084630 con 0x7f451013d980 2023-09-30T01:57:55.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.558+0000 7f45149af700 1 -- 172.21.15.55:0/3806013363 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4510064440 con 0x7f451013d980 2023-09-30T01:57:55.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.558+0000 7f4506ffd700 1 -- 172.21.15.55:0/3806013363 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f4508017070 con 0x7f451013d980 2023-09-30T01:57:55.561 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:55.561 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.562+0000 7f45149af700 10 mgrc shutdown 2023-09-30T01:57:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.562+0000 7f45149af700 1 -- 172.21.15.55:0/3806013363 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f44f008e8b0 msgr2=0x7f44f0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.562+0000 7f45149af700 1 --2- 172.21.15.55:0/3806013363 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f44f008e8b0 0x7f44f0090d60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f45000076c0 tx=0x7f450000b040 comp rx=0 tx=0).stop 2023-09-30T01:57:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.562+0000 7f45149af700 1 -- 172.21.15.55:0/3806013363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f451013d980 msgr2=0x7f45101537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.562+0000 7f45149af700 1 --2- 172.21.15.55:0/3806013363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f451013d980 0x7f45101537d0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f450800c4f0 tx=0x7f4508007f00 comp rx=0 tx=0).stop 2023-09-30T01:57:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.562+0000 7f45149af700 1 -- 172.21.15.55:0/3806013363 shutdown_connections 2023-09-30T01:57:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.562+0000 7f45149af700 1 --2- 172.21.15.55:0/3806013363 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f44f008e8b0 0x7f44f0090d60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:55.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.562+0000 7f45149af700 1 --2- 172.21.15.55:0/3806013363 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f451013d980 0x7f45101537d0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:55.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.562+0000 7f45149af700 1 --2- 172.21.15.55:0/3806013363 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f451013d5b0 0x7f4510153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:55.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.562+0000 7f45149af700 1 --2- 172.21.15.55:0/3806013363 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f45100aba80 0x7f4510142e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:55.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.562+0000 7f45149af700 1 -- 172.21.15.55:0/3806013363 >> 172.21.15.55:0/3806013363 conn(0x7f45100681b0 msgr2=0x7f451006d020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:55.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.562+0000 7f45149af700 1 -- 172.21.15.55:0/3806013363 shutdown_connections 2023-09-30T01:57:55.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:55.562+0000 7f45149af700 1 -- 172.21.15.55:0/3806013363 wait complete. 2023-09-30T01:57:58.576 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:57:58.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece13be700 1 Processor -- start 2023-09-30T01:57:58.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece13be700 1 -- start start 2023-09-30T01:57:58.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece13be700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fecdc143ef0 0x7fecdc0a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:58.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece13be700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fecdc0b0850 0x7fecdc14ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:58.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece13be700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecdc0b0ca0 con 0x7fecdc06b2a0 2023-09-30T01:57:58.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece13be700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecdc148960 con 0x7fecdc143ef0 2023-09-30T01:57:58.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece13be700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc147a20 con 0x7fecdc0b0850 2023-09-30T01:57:58.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece0bbd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fecdc0b0850 0x7fecdc14ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:58.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece0bbd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fecdc0b0850 0x7fecdc14ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43118/0 (socket says 172.21.15.55:43118) 2023-09-30T01:57:58.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece0bbd700 1 -- 172.21.15.55:0/1879155094 learned_addr learned my addr 172.21.15.55:0/1879155094 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:58.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fecdbfff700 1 --2- 172.21.15.55:0/1879155094 >> v2:172.21.15.133:3300/0 conn(0x7fecdc143ef0 0x7fecdc0a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece0bbd700 1 -- 172.21.15.55:0/1879155094 >> v2:172.21.15.133:3300/0 conn(0x7fecdc143ef0 msgr2=0x7fecdc0a44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:57:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece0bbd700 1 --2- 172.21.15.55:0/1879155094 >> v2:172.21.15.133:3300/0 conn(0x7fecdc143ef0 0x7fecdc0a44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece0bbd700 1 -- 172.21.15.55:0/1879155094 >> v1:172.21.15.133:6789/0 conn(0x7fecdc06b2a0 legacy=0x7fecdc0676d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece0bbd700 1 -- 172.21.15.55:0/1879155094 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc06b690 con 0x7fecdc0b0850 2023-09-30T01:57:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fece0bbd700 1 --2- 172.21.15.55:0/1879155094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fecdc0b0850 0x7fecdc14ed20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009f20 tx=0x7fecd4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64049c1145337ec0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.682+0000 7fecdaffd700 1 -- 172.21.15.55:0/1879155094 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd400e070 con 0x7fecdc0b0850 2023-09-30T01:57:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fecdaffd700 1 -- 172.21.15.55:0/1879155094 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd400b9d0 con 0x7fecdc0b0850 2023-09-30T01:57:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fecdaffd700 1 -- 172.21.15.55:0/1879155094 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd40092e0 con 0x7fecdc0b0850 2023-09-30T01:57:58.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 -- 172.21.15.55:0/1879155094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fecdc0b0850 msgr2=0x7fecdc14ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 --2- 172.21.15.55:0/1879155094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fecdc0b0850 0x7fecdc14ed20 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fecd4009f20 tx=0x7fecd4009840 comp rx=0 tx=0).stop 2023-09-30T01:57:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 -- 172.21.15.55:0/1879155094 shutdown_connections 2023-09-30T01:57:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 --2- 172.21.15.55:0/1879155094 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fecdc0b0850 0x7fecdc14ed20 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 --2- 172.21.15.55:0/1879155094 >> v2:172.21.15.133:3300/0 conn(0x7fecdc143ef0 0x7fecdc0a44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 -- 172.21.15.55:0/1879155094 >> 172.21.15.55:0/1879155094 conn(0x7fecdc062e80 msgr2=0x7fecdc063280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 -- 172.21.15.55:0/1879155094 shutdown_connections 2023-09-30T01:57:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 -- 172.21.15.55:0/1879155094 wait complete. 2023-09-30T01:57:58.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 Processor -- start 2023-09-30T01:57:58.688 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 -- start start 2023-09-30T01:57:58.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecdc06b2a0 0x7fecdc14b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:58.689 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc0b0850 0x7fecdc13e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fecdc143ef0 0x7fecdc13e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc13f600 con 0x7fecdc06b2a0 2023-09-30T01:57:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc0a7bd0 con 0x7fecdc0b0850 2023-09-30T01:57:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.686+0000 7fece13be700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecdc13f770 con 0x7fecdc143ef0 2023-09-30T01:57:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fece0bbd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fecdc143ef0 0x7fecdc13e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fecdbfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecdc06b2a0 0x7fecdc14b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fece0bbd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fecdc143ef0 0x7fecdc13e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:43134/0 (socket says 172.21.15.55:43134) 2023-09-30T01:57:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fece0bbd700 1 -- 172.21.15.55:0/4086192682 learned_addr learned my addr 172.21.15.55:0/4086192682 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:57:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fecdb7fe700 1 --2- 172.21.15.55:0/4086192682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc0b0850 0x7fecdc13e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fece0bbd700 1 -- 172.21.15.55:0/4086192682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc0b0850 msgr2=0x7fecdc13e380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:58.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fece0bbd700 1 --2- 172.21.15.55:0/4086192682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc0b0850 0x7fecdc13e380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:58.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fece0bbd700 1 -- 172.21.15.55:0/4086192682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecdc06b2a0 msgr2=0x7fecdc14b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:58.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fece0bbd700 1 --2- 172.21.15.55:0/4086192682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecdc06b2a0 0x7fecdc14b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:58.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fece0bbd700 1 -- 172.21.15.55:0/4086192682 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd4009ae0 con 0x7fecdc143ef0 2023-09-30T01:57:58.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fece0bbd700 1 --2- 172.21.15.55:0/4086192682 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fecdc143ef0 0x7fecdc13e8c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fecd4007710 tx=0x7fecd4018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:58.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fecd3fff700 1 -- 172.21.15.55:0/4086192682 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4007bf0 con 0x7fecdc143ef0 2023-09-30T01:57:58.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fecd3fff700 1 -- 172.21.15.55:0/4086192682 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd4007d70 con 0x7fecdc143ef0 2023-09-30T01:57:58.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fece13be700 1 -- 172.21.15.55:0/4086192682 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecdc0a6880 con 0x7fecdc143ef0 2023-09-30T01:57:58.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fecd3fff700 1 -- 172.21.15.55:0/4086192682 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd401d670 con 0x7fecdc143ef0 2023-09-30T01:57:58.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fece13be700 1 -- 172.21.15.55:0/4086192682 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecdc0a6d80 con 0x7fecdc143ef0 2023-09-30T01:57:58.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.690+0000 7fece13be700 1 -- 172.21.15.55:0/4086192682 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecdc064440 con 0x7fecdc143ef0 2023-09-30T01:57:58.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.694+0000 7fecd3fff700 1 -- 172.21.15.55:0/4086192682 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fecd4003050 con 0x7fecdc143ef0 2023-09-30T01:57:58.693 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.694+0000 7fecd3fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:57:58.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.694+0000 7fecd3fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:57:58.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.694+0000 7fecd3fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:58.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.694+0000 7fecd3fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:57:58.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.694+0000 7fecd3fff700 1 --2- 172.21.15.55:0/4086192682 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fecbc08e8e0 0x7fecbc090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:57:58.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.694+0000 7fecdbfff700 1 --2- 172.21.15.55:0/4086192682 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fecbc08e8e0 0x7fecbc090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:57:58.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.694+0000 7fecd3fff700 1 -- 172.21.15.55:0/4086192682 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fecd40b6520 con 0x7fecdc143ef0 2023-09-30T01:57:58.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.694+0000 7fecdbfff700 1 --2- 172.21.15.55:0/4086192682 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fecbc08e8e0 0x7fecbc090d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009d10 tx=0x7fecc40091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:57:58.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.702+0000 7fecd3fff700 1 -- 172.21.15.55:0/4086192682 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fecd4086f50 con 0x7fecdc143ef0 2023-09-30T01:57:58.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fece13be700 1 -- 172.21.15.55:0/4086192682 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fecdc04b5c0 con 0x7fecdc143ef0 2023-09-30T01:57:58.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fecd3fff700 1 -- 172.21.15.55:0/4086192682 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fecd408a570 con 0x7fecdc143ef0 2023-09-30T01:57:58.902 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:57:58.902 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:57:58.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fece13be700 10 mgrc shutdown 2023-09-30T01:57:58.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fece13be700 1 -- 172.21.15.55:0/4086192682 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fecbc08e8e0 msgr2=0x7fecbc090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:58.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fece13be700 1 --2- 172.21.15.55:0/4086192682 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fecbc08e8e0 0x7fecbc090d90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fecc4009d10 tx=0x7fecc40091a0 comp rx=0 tx=0).stop 2023-09-30T01:57:58.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fece13be700 1 -- 172.21.15.55:0/4086192682 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fecdc143ef0 msgr2=0x7fecdc13e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:57:58.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fece13be700 1 --2- 172.21.15.55:0/4086192682 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fecdc143ef0 0x7fecdc13e8c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fecd4007710 tx=0x7fecd4018000 comp rx=0 tx=0).stop 2023-09-30T01:57:58.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fece13be700 1 -- 172.21.15.55:0/4086192682 shutdown_connections 2023-09-30T01:57:58.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fece13be700 1 --2- 172.21.15.55:0/4086192682 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fecbc08e8e0 0x7fecbc090d90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:58.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fece13be700 1 --2- 172.21.15.55:0/4086192682 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fecdc143ef0 0x7fecdc13e8c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:58.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fece13be700 1 --2- 172.21.15.55:0/4086192682 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fecdc0b0850 0x7fecdc13e380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:58.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fece13be700 1 --2- 172.21.15.55:0/4086192682 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fecdc06b2a0 0x7fecdc14b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:57:58.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fece13be700 1 -- 172.21.15.55:0/4086192682 >> 172.21.15.55:0/4086192682 conn(0x7fecdc062e80 msgr2=0x7fecdc0b29f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:57:58.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fece13be700 1 -- 172.21.15.55:0/4086192682 shutdown_connections 2023-09-30T01:57:58.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:57:58.902+0000 7fece13be700 1 -- 172.21.15.55:0/4086192682 wait complete. 2023-09-30T01:58:01.917 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:02.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.030+0000 7f1f76ec1700 1 Processor -- start 2023-09-30T01:58:02.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.030+0000 7f1f76ec1700 1 -- start start 2023-09-30T01:58:02.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.030+0000 7f1f76ec1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f1f700a1150 0x7f1f7013dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.030+0000 7f1f76ec1700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f7013e520 0x7f1f70148400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f76ec1700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f7009f480 con 0x7f1f700a0d80 2023-09-30T01:58:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f76ec1700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7009f740 con 0x7f1f7013e520 2023-09-30T01:58:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f76ec1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f7013e9a0 con 0x7f1f700a1150 2023-09-30T01:58:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f766c0700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f7013e520 0x7f1f70148400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f766c0700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1f7013e520 0x7f1f70148400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45830/0 (socket says 172.21.15.55:45830) 2023-09-30T01:58:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f766c0700 1 -- 172.21.15.55:0/3230239822 learned_addr learned my addr 172.21.15.55:0/3230239822 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f75ebf700 1 --1- 172.21.15.55:0/3230239822 >> v1:172.21.15.55:6789/0 conn(0x7f1f700a0d80 0x7f1f700a4a90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:45330/0 (socket says 172.21.15.55:45330) 2023-09-30T01:58:02.035 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f756be700 1 --2- 172.21.15.55:0/3230239822 >> v2:172.21.15.133:3300/0 conn(0x7f1f700a1150 0x7f1f7013dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f766c0700 1 -- 172.21.15.55:0/3230239822 >> v2:172.21.15.133:3300/0 conn(0x7f1f700a1150 msgr2=0x7f1f7013dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f766c0700 1 --2- 172.21.15.55:0/3230239822 >> v2:172.21.15.133:3300/0 conn(0x7f1f700a1150 0x7f1f7013dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f766c0700 1 -- 172.21.15.55:0/3230239822 >> v1:172.21.15.55:6789/0 conn(0x7f1f700a0d80 legacy=0x7f1f700a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f74ebd700 1 -- 172.21.15.55:0/3230239822 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557924800 0 0) 0x7f1f7009f480 con 0x7f1f700a0d80 2023-09-30T01:58:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f766c0700 1 -- 172.21.15.55:0/3230239822 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f7006e040 con 0x7f1f7013e520 2023-09-30T01:58:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f756be700 1 --2- 172.21.15.55:0/3230239822 >> v2:172.21.15.133:3300/0 conn(0x7f1f700a1150 0x7f1f7013dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T01:58:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f766c0700 1 --2- 172.21.15.55:0/3230239822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f7013e520 0x7f1f70148400 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1f680099b0 tx=0x7f1f68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b80f688096f0c0a2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f74ebd700 1 -- 172.21.15.55:0/3230239822 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6800b820 con 0x7f1f7013e520 2023-09-30T01:58:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f74ebd700 1 -- 172.21.15.55:0/3230239822 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f6800b980 con 0x7f1f7013e520 2023-09-30T01:58:02.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f74ebd700 1 -- 172.21.15.55:0/3230239822 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f6800bd20 con 0x7f1f7013e520 2023-09-30T01:58:02.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f76ec1700 1 -- 172.21.15.55:0/3230239822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f7013e520 msgr2=0x7f1f70148400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:02.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f76ec1700 1 --2- 172.21.15.55:0/3230239822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f7013e520 0x7f1f70148400 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f1f680099b0 tx=0x7f1f68009250 comp rx=0 tx=0).stop 2023-09-30T01:58:02.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f76ec1700 1 -- 172.21.15.55:0/3230239822 shutdown_connections 2023-09-30T01:58:02.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f76ec1700 1 --2- 172.21.15.55:0/3230239822 >> v2:172.21.15.133:3300/0 conn(0x7f1f700a1150 0x7f1f7013dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:02.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f76ec1700 1 --2- 172.21.15.55:0/3230239822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f7013e520 0x7f1f70148400 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:02.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f76ec1700 1 -- 172.21.15.55:0/3230239822 >> 172.21.15.55:0/3230239822 conn(0x7f1f700b23d0 msgr2=0x7f1f700b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:02.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f76ec1700 1 -- 172.21.15.55:0/3230239822 shutdown_connections 2023-09-30T01:58:02.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.034+0000 7f1f76ec1700 1 -- 172.21.15.55:0/3230239822 wait complete. 2023-09-30T01:58:02.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f76ec1700 1 Processor -- start 2023-09-30T01:58:02.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f76ec1700 1 -- start start 2023-09-30T01:58:02.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f76ec1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f700a0d80 0x7f1f70096520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:02.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f76ec1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f700a1150 0x7f1f7009b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:02.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f76ec1700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f7013e520 0x7f1f7009b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:02.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f76ec1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f70096140 con 0x7f1f700a1150 2023-09-30T01:58:02.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f76ec1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7009a980 con 0x7f1f700a0d80 2023-09-30T01:58:02.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f76ec1700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f7009ab80 con 0x7f1f7013e520 2023-09-30T01:58:02.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f756be700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f700a1150 0x7f1f7009b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:02.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f766c0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f7013e520 0x7f1f7009b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:02.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f756be700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f700a1150 0x7f1f7009b080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45834/0 (socket says 172.21.15.55:45834) 2023-09-30T01:58:02.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f756be700 1 -- 172.21.15.55:0/2534673933 learned_addr learned my addr 172.21.15.55:0/2534673933 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:02.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f75ebf700 1 --2- 172.21.15.55:0/2534673933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f700a0d80 0x7f1f70096520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:02.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f756be700 1 -- 172.21.15.55:0/2534673933 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f7013e520 msgr2=0x7f1f7009b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:02.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f756be700 1 --2- 172.21.15.55:0/2534673933 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f7013e520 0x7f1f7009b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:02.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f756be700 1 -- 172.21.15.55:0/2534673933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f700a0d80 msgr2=0x7f1f70096520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:02.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f756be700 1 --2- 172.21.15.55:0/2534673933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f700a0d80 0x7f1f70096520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:02.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f756be700 1 -- 172.21.15.55:0/2534673933 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f680094f0 con 0x7f1f700a1150 2023-09-30T01:58:02.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f756be700 1 --2- 172.21.15.55:0/2534673933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f700a1150 0x7f1f7009b080 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400a400 tx=0x7f1f64007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:02.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f6dffb700 1 -- 172.21.15.55:0/2534673933 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64015440 con 0x7f1f700a1150 2023-09-30T01:58:02.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f6dffb700 1 -- 172.21.15.55:0/2534673933 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f640155a0 con 0x7f1f700a1150 2023-09-30T01:58:02.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f76ec1700 1 -- 172.21.15.55:0/2534673933 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f70096ef0 con 0x7f1f700a1150 2023-09-30T01:58:02.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f6dffb700 1 -- 172.21.15.55:0/2534673933 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f64015940 con 0x7f1f700a1150 2023-09-30T01:58:02.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.038+0000 7f1f76ec1700 1 -- 172.21.15.55:0/2534673933 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f70097ac0 con 0x7f1f700a1150 2023-09-30T01:58:02.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.042+0000 7f1f76ec1700 1 -- 172.21.15.55:0/2534673933 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f70064440 con 0x7f1f700a1150 2023-09-30T01:58:02.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.042+0000 7f1f6dffb700 1 -- 172.21.15.55:0/2534673933 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f1f64015cb0 con 0x7f1f700a1150 2023-09-30T01:58:02.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.042+0000 7f1f6dffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:02.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.046+0000 7f1f6dffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:02.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.046+0000 7f1f6dffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:02.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.046+0000 7f1f6dffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:02.045 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.046+0000 7f1f6dffb700 1 --2- 172.21.15.55:0/2534673933 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1f5c08e8b0 0x7f1f5c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:02.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.046+0000 7f1f6dffb700 1 -- 172.21.15.55:0/2534673933 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f1f640b57a0 con 0x7f1f700a1150 2023-09-30T01:58:02.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.046+0000 7f1f75ebf700 1 --2- 172.21.15.55:0/2534673933 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1f5c08e8b0 0x7f1f5c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:02.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.046+0000 7f1f75ebf700 1 --2- 172.21.15.55:0/2534673933 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1f5c08e8b0 0x7f1f5c090d60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1f60007180 tx=0x7f1f60007ef0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:02.051 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.050+0000 7f1f6dffb700 1 -- 172.21.15.55:0/2534673933 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1f640861d0 con 0x7f1f700a1150 2023-09-30T01:58:02.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.245+0000 7f1f76ec1700 1 -- 172.21.15.55:0/2534673933 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1f70096280 con 0x7f1f700a1150 2023-09-30T01:58:02.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.245+0000 7f1f6dffb700 1 -- 172.21.15.55:0/2534673933 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f1f6401a100 con 0x7f1f700a1150 2023-09-30T01:58:02.248 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:02.248 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.249+0000 7f1f76ec1700 10 mgrc shutdown 2023-09-30T01:58:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.249+0000 7f1f76ec1700 1 -- 172.21.15.55:0/2534673933 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1f5c08e8b0 msgr2=0x7f1f5c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.249+0000 7f1f76ec1700 1 --2- 172.21.15.55:0/2534673933 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1f5c08e8b0 0x7f1f5c090d60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1f60007180 tx=0x7f1f60007ef0 comp rx=0 tx=0).stop 2023-09-30T01:58:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.249+0000 7f1f76ec1700 1 -- 172.21.15.55:0/2534673933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f700a1150 msgr2=0x7f1f7009b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:02.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.249+0000 7f1f76ec1700 1 --2- 172.21.15.55:0/2534673933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f700a1150 0x7f1f7009b080 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1f6400a400 tx=0x7f1f64007910 comp rx=0 tx=0).stop 2023-09-30T01:58:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.249+0000 7f1f76ec1700 1 -- 172.21.15.55:0/2534673933 shutdown_connections 2023-09-30T01:58:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.249+0000 7f1f76ec1700 1 --2- 172.21.15.55:0/2534673933 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1f5c08e8b0 0x7f1f5c090d60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.249+0000 7f1f76ec1700 1 --2- 172.21.15.55:0/2534673933 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1f7013e520 0x7f1f7009b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.249+0000 7f1f76ec1700 1 --2- 172.21.15.55:0/2534673933 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1f700a1150 0x7f1f7009b080 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.249+0000 7f1f76ec1700 1 --2- 172.21.15.55:0/2534673933 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1f700a0d80 0x7f1f70096520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.249+0000 7f1f76ec1700 1 -- 172.21.15.55:0/2534673933 >> 172.21.15.55:0/2534673933 conn(0x7f1f700b23d0 msgr2=0x7f1f7006e980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.249+0000 7f1f76ec1700 1 -- 172.21.15.55:0/2534673933 shutdown_connections 2023-09-30T01:58:02.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:02.249+0000 7f1f76ec1700 1 -- 172.21.15.55:0/2534673933 wait complete. 2023-09-30T01:58:05.263 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:05.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.373+0000 7f0c81ca6700 1 Processor -- start 2023-09-30T01:58:05.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.373+0000 7f0c81ca6700 1 -- start start 2023-09-30T01:58:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c81ca6700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f0c7c0a4d60 0x7f0c7c0aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c81ca6700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0c7c13a750 0x7f0c7c09f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c81ca6700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c7c0af120 con 0x7f0c7c0a4990 2023-09-30T01:58:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c81ca6700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c7c09f8b0 con 0x7f0c7c0a4d60 2023-09-30T01:58:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c81ca6700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c0af5b0 con 0x7f0c7c13a750 2023-09-30T01:58:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c814a5700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0c7c13a750 0x7f0c7c09f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:05.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c814a5700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0c7c13a750 0x7f0c7c09f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:60222/0 (socket says 172.21.15.55:60222) 2023-09-30T01:58:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c814a5700 1 -- 172.21.15.55:0/4214094502 learned_addr learned my addr 172.21.15.55:0/4214094502 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c7bfff700 1 --2- 172.21.15.55:0/4214094502 >> v2:172.21.15.133:3300/0 conn(0x7f0c7c0a4d60 0x7f0c7c0aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c814a5700 1 -- 172.21.15.55:0/4214094502 >> v2:172.21.15.133:3300/0 conn(0x7f0c7c0a4d60 msgr2=0x7f0c7c0aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c814a5700 1 --2- 172.21.15.55:0/4214094502 >> v2:172.21.15.133:3300/0 conn(0x7f0c7c0a4d60 0x7f0c7c0aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c814a5700 1 -- 172.21.15.55:0/4214094502 >> v1:172.21.15.133:6789/0 conn(0x7f0c7c0a4990 legacy=0x7f0c7c0a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c814a5700 1 -- 172.21.15.55:0/4214094502 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c7c09fb10 con 0x7f0c7c13a750 2023-09-30T01:58:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c814a5700 1 --2- 172.21.15.55:0/4214094502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0c7c13a750 0x7f0c7c09f370 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0c74009f20 tx=0x7f0c74009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=50fab22c31a55e61 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c7b7fe700 1 -- 172.21.15.55:0/4214094502 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c7400e070 con 0x7f0c7c13a750 2023-09-30T01:58:05.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c7b7fe700 1 -- 172.21.15.55:0/4214094502 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c7400b9d0 con 0x7f0c7c13a750 2023-09-30T01:58:05.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c7b7fe700 1 -- 172.21.15.55:0/4214094502 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c740092e0 con 0x7f0c7c13a750 2023-09-30T01:58:05.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c81ca6700 1 -- 172.21.15.55:0/4214094502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0c7c13a750 msgr2=0x7f0c7c09f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c81ca6700 1 --2- 172.21.15.55:0/4214094502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0c7c13a750 0x7f0c7c09f370 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f0c74009f20 tx=0x7f0c74009840 comp rx=0 tx=0).stop 2023-09-30T01:58:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c81ca6700 1 -- 172.21.15.55:0/4214094502 shutdown_connections 2023-09-30T01:58:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c81ca6700 1 --2- 172.21.15.55:0/4214094502 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0c7c13a750 0x7f0c7c09f370 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c81ca6700 1 --2- 172.21.15.55:0/4214094502 >> v2:172.21.15.133:3300/0 conn(0x7f0c7c0a4d60 0x7f0c7c0aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c81ca6700 1 -- 172.21.15.55:0/4214094502 >> 172.21.15.55:0/4214094502 conn(0x7f0c7c0b23d0 msgr2=0x7f0c7c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c81ca6700 1 -- 172.21.15.55:0/4214094502 shutdown_connections 2023-09-30T01:58:05.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.377+0000 7f0c81ca6700 1 -- 172.21.15.55:0/4214094502 wait complete. 2023-09-30T01:58:05.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.381+0000 7f0c81ca6700 1 Processor -- start 2023-09-30T01:58:05.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.381+0000 7f0c81ca6700 1 -- start start 2023-09-30T01:58:05.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.381+0000 7f0c81ca6700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0c7c0a4990 0x7f0c7c097d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:05.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.381+0000 7f0c81ca6700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7c0a4d60 0x7f0c7c099400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:05.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.381+0000 7f0c81ca6700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c7c13a750 0x7f0c7c096a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:05.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.381+0000 7f0c81ca6700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c0979a0 con 0x7f0c7c13a750 2023-09-30T01:58:05.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.381+0000 7f0c81ca6700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c0965b0 con 0x7f0c7c0a4d60 2023-09-30T01:58:05.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.381+0000 7f0c81ca6700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c7c099940 con 0x7f0c7c0a4990 2023-09-30T01:58:05.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.381+0000 7f0c80ca4700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0c7c0a4990 0x7f0c7c097d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:05.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.381+0000 7f0c7bfff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7c0a4d60 0x7f0c7c099400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:05.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.381+0000 7f0c80ca4700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0c7c0a4990 0x7f0c7c097d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:60234/0 (socket says 172.21.15.55:60234) 2023-09-30T01:58:05.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.381+0000 7f0c814a5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c7c13a750 0x7f0c7c096a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:05.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.381+0000 7f0c80ca4700 1 -- 172.21.15.55:0/2494966063 learned_addr learned my addr 172.21.15.55:0/2494966063 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:05.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.385+0000 7f0c80ca4700 1 -- 172.21.15.55:0/2494966063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7c0a4d60 msgr2=0x7f0c7c099400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:05.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.385+0000 7f0c80ca4700 1 --2- 172.21.15.55:0/2494966063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7c0a4d60 0x7f0c7c099400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:05.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.385+0000 7f0c80ca4700 1 -- 172.21.15.55:0/2494966063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c7c13a750 msgr2=0x7f0c7c096a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:05.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.385+0000 7f0c80ca4700 1 --2- 172.21.15.55:0/2494966063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c7c13a750 0x7f0c7c096a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:05.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.385+0000 7f0c80ca4700 1 -- 172.21.15.55:0/2494966063 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c74009ae0 con 0x7f0c7c0a4990 2023-09-30T01:58:05.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.385+0000 7f0c814a5700 1 --2- 172.21.15.55:0/2494966063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c7c13a750 0x7f0c7c096a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:58:05.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.385+0000 7f0c7bfff700 1 --2- 172.21.15.55:0/2494966063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7c0a4d60 0x7f0c7c099400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:58:05.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.385+0000 7f0c80ca4700 1 --2- 172.21.15.55:0/2494966063 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0c7c0a4990 0x7f0c7c097d70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000c4e0 tx=0x7f0c7000c7f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:05.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.385+0000 7f0c78ff9700 1 -- 172.21.15.55:0/2494966063 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70011590 con 0x7f0c7c0a4990 2023-09-30T01:58:05.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.385+0000 7f0c78ff9700 1 -- 172.21.15.55:0/2494966063 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c70011710 con 0x7f0c7c0a4990 2023-09-30T01:58:05.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.385+0000 7f0c81ca6700 1 -- 172.21.15.55:0/2494966063 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c7c0976e0 con 0x7f0c7c0a4990 2023-09-30T01:58:05.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.385+0000 7f0c78ff9700 1 -- 172.21.15.55:0/2494966063 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c70011ad0 con 0x7f0c7c0a4990 2023-09-30T01:58:05.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.385+0000 7f0c81ca6700 1 -- 172.21.15.55:0/2494966063 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c7c096f90 con 0x7f0c7c0a4990 2023-09-30T01:58:05.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.385+0000 7f0c81ca6700 1 -- 172.21.15.55:0/2494966063 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c7c064440 con 0x7f0c7c0a4990 2023-09-30T01:58:05.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.389+0000 7f0c78ff9700 1 -- 172.21.15.55:0/2494966063 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f0c7001b3b0 con 0x7f0c7c0a4990 2023-09-30T01:58:05.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.389+0000 7f0c78ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:05.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.389+0000 7f0c78ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:05.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.389+0000 7f0c78ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:05.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.389+0000 7f0c78ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:05.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.389+0000 7f0c78ff9700 1 --2- 172.21.15.55:0/2494966063 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f0c6808e8b0 0x7f0c68090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:05.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.389+0000 7f0c78ff9700 1 -- 172.21.15.55:0/2494966063 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f0c700b3c40 con 0x7f0c7c0a4990 2023-09-30T01:58:05.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.389+0000 7f0c7bfff700 1 --2- 172.21.15.55:0/2494966063 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f0c6808e8b0 0x7f0c68090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:05.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.389+0000 7f0c7bfff700 1 --2- 172.21.15.55:0/2494966063 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f0c6808e8b0 0x7f0c68090d60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c147c00 tx=0x7f0c6c0091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:05.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.393+0000 7f0c78ff9700 1 -- 172.21.15.55:0/2494966063 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f0c700845e0 con 0x7f0c7c0a4990 2023-09-30T01:58:05.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.589+0000 7f0c81ca6700 1 -- 172.21.15.55:0/2494966063 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0c7c09fdd0 con 0x7f0c7c0a4990 2023-09-30T01:58:05.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.589+0000 7f0c78ff9700 1 -- 172.21.15.55:0/2494966063 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f0c70017070 con 0x7f0c7c0a4990 2023-09-30T01:58:05.591 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:05.591 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.589+0000 7f0c81ca6700 10 mgrc shutdown 2023-09-30T01:58:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.589+0000 7f0c81ca6700 1 -- 172.21.15.55:0/2494966063 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f0c6808e8b0 msgr2=0x7f0c68090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:05.593 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.589+0000 7f0c81ca6700 1 --2- 172.21.15.55:0/2494966063 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f0c6808e8b0 0x7f0c68090d60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0c7c147c00 tx=0x7f0c6c0091a0 comp rx=0 tx=0).stop 2023-09-30T01:58:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.589+0000 7f0c81ca6700 1 -- 172.21.15.55:0/2494966063 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0c7c0a4990 msgr2=0x7f0c7c097d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.589+0000 7f0c81ca6700 1 --2- 172.21.15.55:0/2494966063 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0c7c0a4990 0x7f0c7c097d70 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0c7000c4e0 tx=0x7f0c7000c7f0 comp rx=0 tx=0).stop 2023-09-30T01:58:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.593+0000 7f0c81ca6700 1 -- 172.21.15.55:0/2494966063 shutdown_connections 2023-09-30T01:58:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.593+0000 7f0c81ca6700 1 --2- 172.21.15.55:0/2494966063 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f0c7c13a750 0x7f0c7c096a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.593+0000 7f0c81ca6700 1 --2- 172.21.15.55:0/2494966063 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f0c7c0a4d60 0x7f0c7c099400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.593+0000 7f0c81ca6700 1 --2- 172.21.15.55:0/2494966063 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f0c6808e8b0 0x7f0c68090d60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.593+0000 7f0c81ca6700 1 --2- 172.21.15.55:0/2494966063 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f0c7c0a4990 0x7f0c7c097d70 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.593+0000 7f0c81ca6700 1 -- 172.21.15.55:0/2494966063 >> 172.21.15.55:0/2494966063 conn(0x7f0c7c0b23d0 msgr2=0x7f0c7c147fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.593+0000 7f0c81ca6700 1 -- 172.21.15.55:0/2494966063 shutdown_connections 2023-09-30T01:58:05.594 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:05.593+0000 7f0c81ca6700 1 -- 172.21.15.55:0/2494966063 wait complete. 2023-09-30T01:58:08.606 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:08.718 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c4563700 1 Processor -- start 2023-09-30T01:58:08.719 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c4563700 1 -- start start 2023-09-30T01:58:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c4563700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80bc0b3940 0x7f80bc0a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:08.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c4563700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f80bc0670a0 0x7f80bc0674b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c4563700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc136060 0x7f80bc1364c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c4563700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc0a8e40 con 0x7f80bc0b3940 2023-09-30T01:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c4563700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc0b3d10 con 0x7f80bc0670a0 2023-09-30T01:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c4563700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0679f0 con 0x7f80bc136060 2023-09-30T01:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c22ff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80bc0b3940 0x7f80bc0a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c2b00700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc136060 0x7f80bc1364c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c22ff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f80bc0b3940 0x7f80bc0a88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45856/0 (socket says 172.21.15.55:45856) 2023-09-30T01:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c22ff700 1 -- 172.21.15.55:0/1455679151 learned_addr learned my addr 172.21.15.55:0/1455679151 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c1afe700 1 --2- 172.21.15.55:0/1455679151 >> v2:172.21.15.133:3300/0 conn(0x7f80bc0670a0 0x7f80bc0674b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c22ff700 1 -- 172.21.15.55:0/1455679151 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc136060 msgr2=0x7f80bc1364c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:08.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c22ff700 1 --2- 172.21.15.55:0/1455679151 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc136060 0x7f80bc1364c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c22ff700 1 -- 172.21.15.55:0/1455679151 >> v2:172.21.15.133:3300/0 conn(0x7f80bc0670a0 msgr2=0x7f80bc0674b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c22ff700 1 --2- 172.21.15.55:0/1455679151 >> v2:172.21.15.133:3300/0 conn(0x7f80bc0670a0 0x7f80bc0674b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c22ff700 1 -- 172.21.15.55:0/1455679151 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc067c90 con 0x7f80bc0b3940 2023-09-30T01:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c2b00700 1 --2- 172.21.15.55:0/1455679151 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc136060 0x7f80bc1364c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c22ff700 1 --2- 172.21.15.55:0/1455679151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc0b3940 0x7f80bc0a88d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f80bc06df10 tx=0x7f80b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47aca0ce0e6899c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c12fd700 1 -- 172.21.15.55:0/1455679151 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b400e070 con 0x7f80bc0b3940 2023-09-30T01:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c12fd700 1 -- 172.21.15.55:0/1455679151 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b400ba00 con 0x7f80bc0b3940 2023-09-30T01:58:08.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.717+0000 7f80c12fd700 1 -- 172.21.15.55:0/1455679151 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b40092e0 con 0x7f80bc0b3940 2023-09-30T01:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 -- 172.21.15.55:0/1455679151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc0b3940 msgr2=0x7f80bc0a88d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 --2- 172.21.15.55:0/1455679151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc0b3940 0x7f80bc0a88d0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f80bc06df10 tx=0x7f80b4009840 comp rx=0 tx=0).stop 2023-09-30T01:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 -- 172.21.15.55:0/1455679151 shutdown_connections 2023-09-30T01:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 --2- 172.21.15.55:0/1455679151 >> v2:172.21.15.133:3300/0 conn(0x7f80bc0670a0 0x7f80bc0674b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:08.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 --2- 172.21.15.55:0/1455679151 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc136060 0x7f80bc1364c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 --2- 172.21.15.55:0/1455679151 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc0b3940 0x7f80bc0a88d0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 -- 172.21.15.55:0/1455679151 >> 172.21.15.55:0/1455679151 conn(0x7f80bc062d90 msgr2=0x7f80bc063190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 -- 172.21.15.55:0/1455679151 shutdown_connections 2023-09-30T01:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 -- 172.21.15.55:0/1455679151 wait complete. 2023-09-30T01:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 Processor -- start 2023-09-30T01:58:08.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 -- start start 2023-09-30T01:58:08.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc0670a0 0x7f80bc0aa3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80bc0b3940 0x7f80bc14fa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc136060 0x7f80bc0ab6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c4563700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc0aaf70 con 0x7f80bc136060 2023-09-30T01:58:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.721+0000 7f80c22ff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc0670a0 0x7f80bc0aa3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c4563700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc14ffb0 con 0x7f80bc0b3940 2023-09-30T01:58:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c4563700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc150210 con 0x7f80bc0670a0 2023-09-30T01:58:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c22ff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc0670a0 0x7f80bc0aa3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:60262/0 (socket says 172.21.15.55:60262) 2023-09-30T01:58:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c22ff700 1 -- 172.21.15.55:0/2942730124 learned_addr learned my addr 172.21.15.55:0/2942730124 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c2b00700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc136060 0x7f80bc0ab6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:08.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c1afe700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80bc0b3940 0x7f80bc14fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c2b00700 1 -- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc0670a0 msgr2=0x7f80bc0aa3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c2b00700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc0670a0 0x7f80bc0aa3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c2b00700 1 -- 172.21.15.55:0/2942730124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80bc0b3940 msgr2=0x7f80bc14fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c2b00700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80bc0b3940 0x7f80bc14fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c2b00700 1 -- 172.21.15.55:0/2942730124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b8009420 con 0x7f80bc136060 2023-09-30T01:58:08.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c22ff700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc0670a0 0x7f80bc0aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:58:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c2b00700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc136060 0x7f80bc0ab6c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f80b800e970 tx=0x7f80b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80b27fc700 1 -- 172.21.15.55:0/2942730124 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8013680 con 0x7f80bc136060 2023-09-30T01:58:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80b27fc700 1 -- 172.21.15.55:0/2942730124 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b80137e0 con 0x7f80bc136060 2023-09-30T01:58:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c4563700 1 -- 172.21.15.55:0/2942730124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b4009ae0 con 0x7f80bc136060 2023-09-30T01:58:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80b27fc700 1 -- 172.21.15.55:0/2942730124 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b8013b60 con 0x7f80bc136060 2023-09-30T01:58:08.728 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c4563700 1 -- 172.21.15.55:0/2942730124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80bc0abc00 con 0x7f80bc136060 2023-09-30T01:58:08.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.725+0000 7f80c4563700 1 -- 172.21.15.55:0/2942730124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80bc068300 con 0x7f80bc136060 2023-09-30T01:58:08.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.729+0000 7f80b27fc700 1 -- 172.21.15.55:0/2942730124 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f80b800c400 con 0x7f80bc136060 2023-09-30T01:58:08.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.729+0000 7f80b27fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:08.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.729+0000 7f80b27fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:08.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.729+0000 7f80b27fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:08.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.729+0000 7f80b27fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:08.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.729+0000 7f80b27fc700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f80a008e8b0 0x7f80a0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:08.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.729+0000 7f80b27fc700 1 -- 172.21.15.55:0/2942730124 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f80b80b48d0 con 0x7f80bc136060 2023-09-30T01:58:08.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.729+0000 7f80c22ff700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f80a008e8b0 0x7f80a0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:08.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.729+0000 7f80c22ff700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f80a008e8b0 0x7f80a0090d60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009ab0 tx=0x7f80b4018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:08.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.741+0000 7f80b27fc700 1 -- 172.21.15.55:0/2942730124 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f80b80851d0 con 0x7f80bc136060 2023-09-30T01:58:08.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80c4563700 1 -- 172.21.15.55:0/2942730124 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f80bc067f50 con 0x7f80bc136060 2023-09-30T01:58:08.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80b27fc700 1 -- 172.21.15.55:0/2942730124 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f80b8017080 con 0x7f80bc136060 2023-09-30T01:58:08.943 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:08.943 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:08.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80c4563700 10 mgrc shutdown 2023-09-30T01:58:08.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80c4563700 1 -- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f80a008e8b0 msgr2=0x7f80a0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:08.945 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80c4563700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f80a008e8b0 0x7f80a0090d60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f80b4009ab0 tx=0x7f80b4018000 comp rx=0 tx=0).stop 2023-09-30T01:58:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80c4563700 1 -- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc136060 msgr2=0x7f80bc0ab6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80c4563700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc136060 0x7f80bc0ab6c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f80b800e970 tx=0x7f80b80091a0 comp rx=0 tx=0).stop 2023-09-30T01:58:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80c4563700 1 -- 172.21.15.55:0/2942730124 shutdown_connections 2023-09-30T01:58:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80c4563700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f80bc136060 0x7f80bc0ab6c0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80c4563700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f80bc0b3940 0x7f80bc14fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80c4563700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f80a008e8b0 0x7f80a0090d60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80c4563700 1 --2- 172.21.15.55:0/2942730124 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f80bc0670a0 0x7f80bc0aa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80c4563700 1 -- 172.21.15.55:0/2942730124 >> 172.21.15.55:0/2942730124 conn(0x7f80bc062d90 msgr2=0x7f80bc063160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:08.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80c4563700 1 -- 172.21.15.55:0/2942730124 shutdown_connections 2023-09-30T01:58:08.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:08.941+0000 7f80c4563700 1 -- 172.21.15.55:0/2942730124 wait complete. 2023-09-30T01:58:11.957 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:12.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 Processor -- start 2023-09-30T01:58:12.070 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 -- start start 2023-09-30T01:58:12.071 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fcdcc13d490 0x7fcdcc06c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:12.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdcc06ff20 0x7fcdcc13fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:12.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcdcc0702f0 0x7fcdcc140400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:12.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc06c810 con 0x7fcdcc0702f0 2023-09-30T01:58:12.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdcc1409e0 con 0x7fcdcc13d490 2023-09-30T01:58:12.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc140ca0 con 0x7fcdcc06ff20 2023-09-30T01:58:12.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdcb7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdcc06ff20 0x7fcdcc13fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:12.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd099e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcdcc0702f0 0x7fcdcc140400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:12.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdcb7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdcc06ff20 0x7fcdcc13fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:46592/0 (socket says 172.21.15.55:46592) 2023-09-30T01:58:12.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdcb7fe700 1 -- 172.21.15.55:0/475713777 learned_addr learned my addr 172.21.15.55:0/475713777 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:12.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdcbfff700 1 --2- 172.21.15.55:0/475713777 >> v2:172.21.15.133:3300/0 conn(0x7fcdcc13d490 0x7fcdcc06c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:12.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdcb7fe700 1 -- 172.21.15.55:0/475713777 >> v2:172.21.15.133:3300/0 conn(0x7fcdcc13d490 msgr2=0x7fcdcc06c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:12.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdcb7fe700 1 --2- 172.21.15.55:0/475713777 >> v2:172.21.15.133:3300/0 conn(0x7fcdcc13d490 0x7fcdcc06c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:12.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdcb7fe700 1 -- 172.21.15.55:0/475713777 >> v2:172.21.15.55:3300/0 conn(0x7fcdcc0702f0 msgr2=0x7fcdcc140400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:12.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdcb7fe700 1 --2- 172.21.15.55:0/475713777 >> v2:172.21.15.55:3300/0 conn(0x7fcdcc0702f0 0x7fcdcc140400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:12.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdcb7fe700 1 -- 172.21.15.55:0/475713777 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdcc06ccb0 con 0x7fcdcc06ff20 2023-09-30T01:58:12.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdcb7fe700 1 --2- 172.21.15.55:0/475713777 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdcc06ff20 0x7fcdcc13fec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc063840 tx=0x7fcdbc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e550d86da8225582 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:12.073 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdcaffd700 1 -- 172.21.15.55:0/475713777 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc00e070 con 0x7fcdcc06ff20 2023-09-30T01:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdcaffd700 1 -- 172.21.15.55:0/475713777 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdbc00b970 con 0x7fcdcc06ff20 2023-09-30T01:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdcaffd700 1 -- 172.21.15.55:0/475713777 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdbc0092e0 con 0x7fcdcc06ff20 2023-09-30T01:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 -- 172.21.15.55:0/475713777 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdcc06ff20 msgr2=0x7fcdcc13fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 --2- 172.21.15.55:0/475713777 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdcc06ff20 0x7fcdcc13fec0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fcdcc063840 tx=0x7fcdbc009840 comp rx=0 tx=0).stop 2023-09-30T01:58:12.074 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 -- 172.21.15.55:0/475713777 shutdown_connections 2023-09-30T01:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 --2- 172.21.15.55:0/475713777 >> v2:172.21.15.55:3300/0 conn(0x7fcdcc0702f0 0x7fcdcc140400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 --2- 172.21.15.55:0/475713777 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdcc06ff20 0x7fcdcc13fec0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 --2- 172.21.15.55:0/475713777 >> v2:172.21.15.133:3300/0 conn(0x7fcdcc13d490 0x7fcdcc06c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 -- 172.21.15.55:0/475713777 >> 172.21.15.55:0/475713777 conn(0x7fcdcc0b2cf0 msgr2=0x7fcdcc0b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 -- 172.21.15.55:0/475713777 shutdown_connections 2023-09-30T01:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.069+0000 7fcdd119f700 1 -- 172.21.15.55:0/475713777 wait complete. 2023-09-30T01:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd119f700 1 Processor -- start 2023-09-30T01:58:12.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd119f700 1 -- start start 2023-09-30T01:58:12.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd119f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdcc0702f0 0x7fcdcc0ae450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:12.077 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd119f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdcc13d490 0x7fcdcc14fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:12.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd119f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdcc0ac920 0x7fcdcc0acd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:12.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd119f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc0ada90 con 0x7fcdcc0ac920 2023-09-30T01:58:12.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd119f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc13b010 con 0x7fcdcc13d490 2023-09-30T01:58:12.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd119f700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdcc150780 con 0x7fcdcc0702f0 2023-09-30T01:58:12.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd099e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdcc0ac920 0x7fcdcc0acd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:12.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdcbfff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdcc0702f0 0x7fcdcc0ae450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:12.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd099e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdcc0ac920 0x7fcdcc0acd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:57546/0 (socket says 172.21.15.55:57546) 2023-09-30T01:58:12.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd099e700 1 -- 172.21.15.55:0/1815106096 learned_addr learned my addr 172.21.15.55:0/1815106096 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:12.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdcb7fe700 1 --2- 172.21.15.55:0/1815106096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdcc13d490 0x7fcdcc14fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:12.078 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd099e700 1 -- 172.21.15.55:0/1815106096 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdcc0702f0 msgr2=0x7fcdcc0ae450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd099e700 1 --2- 172.21.15.55:0/1815106096 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdcc0702f0 0x7fcdcc0ae450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd099e700 1 -- 172.21.15.55:0/1815106096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdcc13d490 msgr2=0x7fcdcc14fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd099e700 1 --2- 172.21.15.55:0/1815106096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdcc13d490 0x7fcdcc14fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd099e700 1 -- 172.21.15.55:0/1815106096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdbc009ae0 con 0x7fcdcc0ac920 2023-09-30T01:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.073+0000 7fcdd099e700 1 --2- 172.21.15.55:0/1815106096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdcc0ac920 0x7fcdcc0acd90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400ea80 tx=0x7fcdc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.077+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1815106096 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400eec0 con 0x7fcdcc0ac920 2023-09-30T01:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.077+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1815106096 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdc400c850 con 0x7fcdcc0ac920 2023-09-30T01:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.077+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1815106096 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdc400cc10 con 0x7fcdcc0ac920 2023-09-30T01:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.077+0000 7fcdd119f700 1 -- 172.21.15.55:0/1815106096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdcc150a40 con 0x7fcdcc0ac920 2023-09-30T01:58:12.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.077+0000 7fcdd119f700 1 -- 172.21.15.55:0/1815106096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdcc0aade0 con 0x7fcdcc0ac920 2023-09-30T01:58:12.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.077+0000 7fcdd119f700 1 -- 172.21.15.55:0/1815106096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdcc064440 con 0x7fcdcc0ac920 2023-09-30T01:58:12.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.077+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1815106096 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fcdc4013470 con 0x7fcdcc0ac920 2023-09-30T01:58:12.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.077+0000 7fcdc3fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:12.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.081+0000 7fcdc3fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:12.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.081+0000 7fcdc3fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:12.081 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.081+0000 7fcdc3fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:12.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.081+0000 7fcdc3fff700 1 --2- 172.21.15.55:0/1815106096 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcdac08e8b0 0x7fcdac090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:12.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.081+0000 7fcdcbfff700 1 --2- 172.21.15.55:0/1815106096 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcdac08e8b0 0x7fcdac090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:12.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.081+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1815106096 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fcdc40b51d0 con 0x7fcdcc0ac920 2023-09-30T01:58:12.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.081+0000 7fcdcbfff700 1 --2- 172.21.15.55:0/1815106096 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcdac08e8b0 0x7fcdac090d60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009d00 tx=0x7fcdb4009120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:12.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.085+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1815106096 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcdc4085c00 con 0x7fcdcc0ac920 2023-09-30T01:58:12.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.281+0000 7fcdd119f700 1 -- 172.21.15.55:0/1815106096 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcdcc13b1a0 con 0x7fcdcc0ac920 2023-09-30T01:58:12.285 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.281+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1815106096 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fcdc4089220 con 0x7fcdcc0ac920 2023-09-30T01:58:12.285 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:12.285 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:12.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.285+0000 7fcdd119f700 10 mgrc shutdown 2023-09-30T01:58:12.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.285+0000 7fcdd119f700 1 -- 172.21.15.55:0/1815106096 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcdac08e8b0 msgr2=0x7fcdac090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:12.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.285+0000 7fcdd119f700 1 --2- 172.21.15.55:0/1815106096 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcdac08e8b0 0x7fcdac090d60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fcdb4009d00 tx=0x7fcdb4009120 comp rx=0 tx=0).stop 2023-09-30T01:58:12.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.285+0000 7fcdd119f700 1 -- 172.21.15.55:0/1815106096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdcc0ac920 msgr2=0x7fcdcc0acd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:12.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.285+0000 7fcdd119f700 1 --2- 172.21.15.55:0/1815106096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdcc0ac920 0x7fcdcc0acd90 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fcdc400ea80 tx=0x7fcdc40091a0 comp rx=0 tx=0).stop 2023-09-30T01:58:12.288 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.285+0000 7fcdd119f700 1 -- 172.21.15.55:0/1815106096 shutdown_connections 2023-09-30T01:58:12.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.285+0000 7fcdd119f700 1 --2- 172.21.15.55:0/1815106096 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdcc0ac920 0x7fcdcc0acd90 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:12.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.285+0000 7fcdd119f700 1 --2- 172.21.15.55:0/1815106096 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdcc13d490 0x7fcdcc14fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:12.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.285+0000 7fcdd119f700 1 --2- 172.21.15.55:0/1815106096 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcdac08e8b0 0x7fcdac090d60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:12.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.285+0000 7fcdd119f700 1 --2- 172.21.15.55:0/1815106096 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdcc0702f0 0x7fcdcc0ae450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:12.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.285+0000 7fcdd119f700 1 -- 172.21.15.55:0/1815106096 >> 172.21.15.55:0/1815106096 conn(0x7fcdcc0b2cf0 msgr2=0x7fcdcc13c010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:12.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.285+0000 7fcdd119f700 1 -- 172.21.15.55:0/1815106096 shutdown_connections 2023-09-30T01:58:12.289 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:12.285+0000 7fcdd119f700 1 -- 172.21.15.55:0/1815106096 wait complete. 2023-09-30T01:58:13.990 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:58:13.993 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:58:15.300 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:15.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88cb25c700 1 Processor -- start 2023-09-30T01:58:15.413 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88cb25c700 1 -- start start 2023-09-30T01:58:15.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88cb25c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c40a5eb0 0x7f88c414b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:15.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88cb25c700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c4067b90 con 0x7f88c40677c0 2023-09-30T01:58:15.414 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88cb25c700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88c40a5460 con 0x7f88c40a65f0 2023-09-30T01:58:15.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88cb25c700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40a9ae0 con 0x7f88c40a5eb0 2023-09-30T01:58:15.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88ca25a700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f88c40677c0 0x7f88c40a93d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47426/0 (socket says 172.21.15.55:47426) 2023-09-30T01:58:15.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88ca25a700 1 -- 172.21.15.55:0/300188479 learned_addr learned my addr 172.21.15.55:0/300188479 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:58:15.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88caa5b700 1 --2- 172.21.15.55:0/300188479 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c40a5eb0 0x7f88c414b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:15.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 -- 172.21.15.55:0/300188479 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3747143763 0 0) 0x7f88c4067b90 con 0x7f88c40677c0 2023-09-30T01:58:15.415 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 -- 172.21.15.55:0/300188479 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88b0003570 con 0x7f88c40677c0 2023-09-30T01:58:15.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 -- 172.21.15.55:0/300188479 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3460354661 0 0) 0x7f88b0003570 con 0x7f88c40677c0 2023-09-30T01:58:15.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 -- 172.21.15.55:0/300188479 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c40a5eb0 msgr2=0x7f88c414b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:15.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 --2- 172.21.15.55:0/300188479 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c40a5eb0 0x7f88c414b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:15.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 -- 172.21.15.55:0/300188479 >> v1:172.21.15.133:6789/0 conn(0x7f88c40a65f0 legacy=0x7f88c413f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:15.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 -- 172.21.15.55:0/300188479 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c40a5720 con 0x7f88c40677c0 2023-09-30T01:58:15.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 -- 172.21.15.55:0/300188479 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 254224620 0 0) 0x7f88c0001470 con 0x7f88c40677c0 2023-09-30T01:58:15.417 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 -- 172.21.15.55:0/300188479 >> v1:172.21.15.55:6789/0 conn(0x7f88c40677c0 legacy=0x7f88c40a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:15.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 --2- 172.21.15.55:0/300188479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88b0003a90 0x7f88b0003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:15.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 --2- 172.21.15.55:0/300188479 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c40a5eb0 0x7f88b0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:15.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 --2- 172.21.15.55:0/300188479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b0004d50 0x7f88b00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:15.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 -- 172.21.15.55:0/300188479 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c40a9ae0 con 0x7f88b0003a90 2023-09-30T01:58:15.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 -- 172.21.15.55:0/300188479 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88b000bb10 con 0x7f88b0004d50 2023-09-30T01:58:15.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 -- 172.21.15.55:0/300188479 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88b000bcd0 con 0x7f88c40a5eb0 2023-09-30T01:58:15.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9a59700 1 --2- 172.21.15.55:0/300188479 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c40a5eb0 0x7f88b0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:15.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88ca25a700 1 --2- 172.21.15.55:0/300188479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88b0003a90 0x7f88b0003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:15.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88caa5b700 1 --2- 172.21.15.55:0/300188479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b0004d50 0x7f88b00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:15.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9a59700 1 -- 172.21.15.55:0/300188479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b0004d50 msgr2=0x7f88b00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:15.418 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9a59700 1 --2- 172.21.15.55:0/300188479 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88b0004d50 0x7f88b00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:15.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9a59700 1 -- 172.21.15.55:0/300188479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88b0003a90 msgr2=0x7f88b0003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:15.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9a59700 1 --2- 172.21.15.55:0/300188479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88b0003a90 0x7f88b0003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:15.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9a59700 1 -- 172.21.15.55:0/300188479 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88b0003570 con 0x7f88c40a5eb0 2023-09-30T01:58:15.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88ca25a700 1 --2- 172.21.15.55:0/300188479 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88b0003a90 0x7f88b0003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:58:15.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9a59700 1 --2- 172.21.15.55:0/300188479 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c40a5eb0 0x7f88b0004810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f88b40019a0 tx=0x7f88b4007d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bda31b3fc81a7036 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:15.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 -- 172.21.15.55:0/300188479 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b400c5d0 con 0x7f88c40a5eb0 2023-09-30T01:58:15.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 -- 172.21.15.55:0/300188479 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b400c750 con 0x7f88c40a5eb0 2023-09-30T01:58:15.419 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.413+0000 7f88c9258700 1 -- 172.21.15.55:0/300188479 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b400cb10 con 0x7f88c40a5eb0 2023-09-30T01:58:15.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.417+0000 7f88cb25c700 1 -- 172.21.15.55:0/300188479 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c40a5eb0 msgr2=0x7f88b0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:15.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.417+0000 7f88cb25c700 1 --2- 172.21.15.55:0/300188479 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c40a5eb0 0x7f88b0004810 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f88b40019a0 tx=0x7f88b4007d10 comp rx=0 tx=0).stop 2023-09-30T01:58:15.420 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.417+0000 7f88caa5b700 1 -- 172.21.15.55:0/300188479 reap_dead start 2023-09-30T01:58:15.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.417+0000 7f88cb25c700 1 -- 172.21.15.55:0/300188479 shutdown_connections 2023-09-30T01:58:15.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.417+0000 7f88cb25c700 1 -- 172.21.15.55:0/300188479 >> 172.21.15.55:0/300188479 conn(0x7f88c4068820 msgr2=0x7f88c4068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:15.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.417+0000 7f88cb25c700 1 -- 172.21.15.55:0/300188479 shutdown_connections 2023-09-30T01:58:15.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.417+0000 7f88cb25c700 1 -- 172.21.15.55:0/300188479 wait complete. 2023-09-30T01:58:15.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.417+0000 7f88cb25c700 1 Processor -- start 2023-09-30T01:58:15.422 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.417+0000 7f88cb25c700 1 -- start start 2023-09-30T01:58:15.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88cb25c700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c40a5eb0 0x7f88c40b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:15.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88cb25c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c406bb10 0x7f88c4141490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:15.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88cb25c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88c41419d0 0x7f88c4139ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:15.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88cb25c700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c406b3a0 con 0x7f88c41419d0 2023-09-30T01:58:15.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88cb25c700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c4141ef0 con 0x7f88c40a5eb0 2023-09-30T01:58:15.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88cb25c700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c41421b0 con 0x7f88c406bb10 2023-09-30T01:58:15.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88c9a59700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c406bb10 0x7f88c4141490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:15.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88c9a59700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c406bb10 0x7f88c4141490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:46634/0 (socket says 172.21.15.55:46634) 2023-09-30T01:58:15.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88c9a59700 1 -- 172.21.15.55:0/1895844361 learned_addr learned my addr 172.21.15.55:0/1895844361 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:15.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88ca25a700 1 --2- 172.21.15.55:0/1895844361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c40a5eb0 0x7f88c40b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:15.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88caa5b700 1 --2- 172.21.15.55:0/1895844361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88c41419d0 0x7f88c4139ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:15.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88c9a59700 1 -- 172.21.15.55:0/1895844361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c40a5eb0 msgr2=0x7f88c40b5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:15.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88c9a59700 1 --2- 172.21.15.55:0/1895844361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c40a5eb0 0x7f88c40b5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:15.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88c9a59700 1 -- 172.21.15.55:0/1895844361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88c41419d0 msgr2=0x7f88c4139ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:15.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88c9a59700 1 --2- 172.21.15.55:0/1895844361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88c41419d0 0x7f88c4139ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:15.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88c9a59700 1 -- 172.21.15.55:0/1895844361 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c406c4f0 con 0x7f88c406bb10 2023-09-30T01:58:15.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88c9a59700 1 --2- 172.21.15.55:0/1895844361 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c406bb10 0x7f88c4141490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88b400c3c0 tx=0x7f88b4015000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:15.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88ba7fc700 1 -- 172.21.15.55:0/1895844361 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b4007af0 con 0x7f88c406bb10 2023-09-30T01:58:15.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88ba7fc700 1 -- 172.21.15.55:0/1895844361 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88b400c5d0 con 0x7f88c406bb10 2023-09-30T01:58:15.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88cb25c700 1 -- 172.21.15.55:0/1895844361 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c406bf00 con 0x7f88c406bb10 2023-09-30T01:58:15.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88ba7fc700 1 -- 172.21.15.55:0/1895844361 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88b400caf0 con 0x7f88c406bb10 2023-09-30T01:58:15.425 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88cb25c700 1 -- 172.21.15.55:0/1895844361 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c413a3e0 con 0x7f88c406bb10 2023-09-30T01:58:15.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.421+0000 7f88cb25c700 1 -- 172.21.15.55:0/1895844361 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c4064440 con 0x7f88c406bb10 2023-09-30T01:58:15.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.425+0000 7f88ba7fc700 1 -- 172.21.15.55:0/1895844361 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f88b4019070 con 0x7f88c406bb10 2023-09-30T01:58:15.426 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.425+0000 7f88ba7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:15.427 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.425+0000 7f88ba7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:15.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.425+0000 7f88ba7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:15.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.425+0000 7f88ba7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:15.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.425+0000 7f88ba7fc700 1 --2- 172.21.15.55:0/1895844361 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f88a808e830 0x7f88a8090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:15.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.425+0000 7f88ca25a700 1 --2- 172.21.15.55:0/1895844361 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f88a808e830 0x7f88a8090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:15.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.425+0000 7f88ba7fc700 1 -- 172.21.15.55:0/1895844361 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f88b40b6160 con 0x7f88c406bb10 2023-09-30T01:58:15.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.425+0000 7f88ca25a700 1 --2- 172.21.15.55:0/1895844361 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f88a808e830 0x7f88a8090ce0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f88c0001ed0 tx=0x7f88c40a4420 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:15.431 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.429+0000 7f88ba7fc700 1 -- 172.21.15.55:0/1895844361 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f88b4086c50 con 0x7f88c406bb10 2023-09-30T01:58:15.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.621+0000 7f88cb25c700 1 -- 172.21.15.55:0/1895844361 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f88c413f110 con 0x7f88c406bb10 2023-09-30T01:58:15.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.621+0000 7f88ba7fc700 1 -- 172.21.15.55:0/1895844361 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f88b4017100 con 0x7f88c406bb10 2023-09-30T01:58:15.624 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:15.624 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:15.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.625+0000 7f88cb25c700 10 mgrc shutdown 2023-09-30T01:58:15.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.625+0000 7f88cb25c700 1 -- 172.21.15.55:0/1895844361 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f88a808e830 msgr2=0x7f88a8090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:15.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.625+0000 7f88cb25c700 1 --2- 172.21.15.55:0/1895844361 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f88a808e830 0x7f88a8090ce0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f88c0001ed0 tx=0x7f88c40a4420 comp rx=0 tx=0).stop 2023-09-30T01:58:15.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.625+0000 7f88cb25c700 1 -- 172.21.15.55:0/1895844361 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c406bb10 msgr2=0x7f88c4141490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:15.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.625+0000 7f88cb25c700 1 --2- 172.21.15.55:0/1895844361 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c406bb10 0x7f88c4141490 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f88b400c3c0 tx=0x7f88b4015000 comp rx=0 tx=0).stop 2023-09-30T01:58:15.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.625+0000 7f88cb25c700 1 -- 172.21.15.55:0/1895844361 shutdown_connections 2023-09-30T01:58:15.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.625+0000 7f88cb25c700 1 --2- 172.21.15.55:0/1895844361 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f88c41419d0 0x7f88c4139ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:15.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.625+0000 7f88cb25c700 1 --2- 172.21.15.55:0/1895844361 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f88a808e830 0x7f88a8090ce0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:15.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.625+0000 7f88cb25c700 1 --2- 172.21.15.55:0/1895844361 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f88c406bb10 0x7f88c4141490 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:15.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.625+0000 7f88cb25c700 1 --2- 172.21.15.55:0/1895844361 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f88c40a5eb0 0x7f88c40b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:15.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.625+0000 7f88cb25c700 1 -- 172.21.15.55:0/1895844361 >> 172.21.15.55:0/1895844361 conn(0x7f88c4068820 msgr2=0x7f88c4140c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:15.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.625+0000 7f88cb25c700 1 -- 172.21.15.55:0/1895844361 shutdown_connections 2023-09-30T01:58:15.628 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:15.625+0000 7f88cb25c700 1 -- 172.21.15.55:0/1895844361 wait complete. 2023-09-30T01:58:18.640 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:18.755 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.753+0000 7f8c1e797700 1 Processor -- start 2023-09-30T01:58:18.756 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.753+0000 7f8c1e797700 1 -- start start 2023-09-30T01:58:18.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.753+0000 7f8c1e797700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f8c180a4bc0 0x7f8c1806af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:18.757 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.753+0000 7f8c1e797700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1813d770 0x7f8c1806c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.753+0000 7f8c1e797700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c180a1880 con 0x7f8c1806c360 2023-09-30T01:58:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.753+0000 7f8c1e797700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c180a4f90 con 0x7f8c180a4bc0 2023-09-30T01:58:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.753+0000 7f8c1e797700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c180a1ab0 con 0x7f8c1813d770 2023-09-30T01:58:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.753+0000 7f8c1df96700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1813d770 0x7f8c1806c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.753+0000 7f8c1df96700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1813d770 0x7f8c1806c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:46638/0 (socket says 172.21.15.55:46638) 2023-09-30T01:58:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.753+0000 7f8c1df96700 1 -- 172.21.15.55:0/427128536 learned_addr learned my addr 172.21.15.55:0/427128536 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.753+0000 7f8c1d795700 1 --2- 172.21.15.55:0/427128536 >> v2:172.21.15.133:3300/0 conn(0x7f8c180a4bc0 0x7f8c1806af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.753+0000 7f8c1df96700 1 -- 172.21.15.55:0/427128536 >> v2:172.21.15.133:3300/0 conn(0x7f8c180a4bc0 msgr2=0x7f8c1806af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.753+0000 7f8c1df96700 1 --2- 172.21.15.55:0/427128536 >> v2:172.21.15.133:3300/0 conn(0x7f8c180a4bc0 0x7f8c1806af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.753+0000 7f8c1df96700 1 -- 172.21.15.55:0/427128536 >> v1:172.21.15.133:6789/0 conn(0x7f8c1806c360 legacy=0x7f8c1813d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:18.758 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c1df96700 1 -- 172.21.15.55:0/427128536 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c180a1d70 con 0x7f8c1813d770 2023-09-30T01:58:18.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c1d795700 1 --2- 172.21.15.55:0/427128536 >> v2:172.21.15.133:3300/0 conn(0x7f8c180a4bc0 0x7f8c1806af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T01:58:18.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c1df96700 1 --2- 172.21.15.55:0/427128536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1813d770 0x7f8c1806c730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c180a5430 tx=0x7f8c10009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9040096a775697cb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:18.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c0ffff700 1 -- 172.21.15.55:0/427128536 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1000e070 con 0x7f8c1813d770 2023-09-30T01:58:18.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c0ffff700 1 -- 172.21.15.55:0/427128536 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c1000ba10 con 0x7f8c1813d770 2023-09-30T01:58:18.759 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c0ffff700 1 -- 172.21.15.55:0/427128536 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c100092e0 con 0x7f8c1813d770 2023-09-30T01:58:18.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c1e797700 1 -- 172.21.15.55:0/427128536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1813d770 msgr2=0x7f8c1806c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:18.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c1e797700 1 --2- 172.21.15.55:0/427128536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1813d770 0x7f8c1806c730 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8c180a5430 tx=0x7f8c10009840 comp rx=0 tx=0).stop 2023-09-30T01:58:18.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c1e797700 1 -- 172.21.15.55:0/427128536 shutdown_connections 2023-09-30T01:58:18.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c1e797700 1 --2- 172.21.15.55:0/427128536 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1813d770 0x7f8c1806c730 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:18.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c1e797700 1 --2- 172.21.15.55:0/427128536 >> v2:172.21.15.133:3300/0 conn(0x7f8c180a4bc0 0x7f8c1806af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:18.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c1e797700 1 -- 172.21.15.55:0/427128536 >> 172.21.15.55:0/427128536 conn(0x7f8c180b23d0 msgr2=0x7f8c180b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:18.760 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c1e797700 1 -- 172.21.15.55:0/427128536 shutdown_connections 2023-09-30T01:58:18.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c1e797700 1 -- 172.21.15.55:0/427128536 wait complete. 2023-09-30T01:58:18.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c1e797700 1 Processor -- start 2023-09-30T01:58:18.761 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.757+0000 7f8c1e797700 1 -- start start 2023-09-30T01:58:18.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1e797700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c1806c360 0x7f8c1813b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:18.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1e797700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c180a4bc0 0x7f8c1814ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:18.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1e797700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1813d770 0x7f8c18150510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:18.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1e797700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c18150a50 con 0x7f8c1806c360 2023-09-30T01:58:18.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1e797700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c18095d30 con 0x7f8c180a4bc0 2023-09-30T01:58:18.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1e797700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c18099560 con 0x7f8c1813d770 2023-09-30T01:58:18.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1df96700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1813d770 0x7f8c18150510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:18.763 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1d795700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c1806c360 0x7f8c1813b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:18.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1df96700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1813d770 0x7f8c18150510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:46642/0 (socket says 172.21.15.55:46642) 2023-09-30T01:58:18.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1df96700 1 -- 172.21.15.55:0/1184900313 learned_addr learned my addr 172.21.15.55:0/1184900313 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:18.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1cf94700 1 --2- 172.21.15.55:0/1184900313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c180a4bc0 0x7f8c1814ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:18.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1df96700 1 -- 172.21.15.55:0/1184900313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c180a4bc0 msgr2=0x7f8c1814ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:18.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1df96700 1 --2- 172.21.15.55:0/1184900313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c180a4bc0 0x7f8c1814ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:18.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1df96700 1 -- 172.21.15.55:0/1184900313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c1806c360 msgr2=0x7f8c1813b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:18.764 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1df96700 1 --2- 172.21.15.55:0/1184900313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c1806c360 0x7f8c1813b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:18.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1df96700 1 -- 172.21.15.55:0/1184900313 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c10009ae0 con 0x7f8c1813d770 2023-09-30T01:58:18.768 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1df96700 1 --2- 172.21.15.55:0/1184900313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1813d770 0x7f8c18150510 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009880 tx=0x7f8c10018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:18.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c0d7fa700 1 -- 172.21.15.55:0/1184900313 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c10007ce0 con 0x7f8c1813d770 2023-09-30T01:58:18.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c0d7fa700 1 -- 172.21.15.55:0/1184900313 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c10007e60 con 0x7f8c1813d770 2023-09-30T01:58:18.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c0d7fa700 1 -- 172.21.15.55:0/1184900313 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c1001d670 con 0x7f8c1813d770 2023-09-30T01:58:18.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1e797700 1 -- 172.21.15.55:0/1184900313 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c18150cf0 con 0x7f8c1813d770 2023-09-30T01:58:18.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.761+0000 7f8c1e797700 1 -- 172.21.15.55:0/1184900313 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c1813c1f0 con 0x7f8c1813d770 2023-09-30T01:58:18.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.765+0000 7f8c1e797700 1 -- 172.21.15.55:0/1184900313 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c18064440 con 0x7f8c1813d770 2023-09-30T01:58:18.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.765+0000 7f8c0d7fa700 1 -- 172.21.15.55:0/1184900313 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f8c10003040 con 0x7f8c1813d770 2023-09-30T01:58:18.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.765+0000 7f8c0d7fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:18.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.769+0000 7f8c0d7fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:18.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.769+0000 7f8c0d7fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:18.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.769+0000 7f8c0d7fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:18.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.769+0000 7f8c0d7fa700 1 --2- 172.21.15.55:0/1184900313 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f8bfc08e8e0 0x7f8bfc090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:18.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.769+0000 7f8c1d795700 1 --2- 172.21.15.55:0/1184900313 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f8bfc08e8e0 0x7f8bfc090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:18.771 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.769+0000 7f8c0d7fa700 1 -- 172.21.15.55:0/1184900313 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f8c100b6720 con 0x7f8c1813d770 2023-09-30T01:58:18.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.769+0000 7f8c1d795700 1 --2- 172.21.15.55:0/1184900313 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f8bfc08e8e0 0x7f8bfc090d90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800adc0 tx=0x7f8c08006f90 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:18.772 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.769+0000 7f8c0d7fa700 1 -- 172.21.15.55:0/1184900313 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8c10087150 con 0x7f8c1813d770 2023-09-30T01:58:18.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.961+0000 7f8c1e797700 1 -- 172.21.15.55:0/1184900313 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8c180996a0 con 0x7f8c1813d770 2023-09-30T01:58:18.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.965+0000 7f8c0d7fa700 1 -- 172.21.15.55:0/1184900313 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f8c1008a770 con 0x7f8c1813d770 2023-09-30T01:58:18.965 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:18.965 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:18.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.965+0000 7f8c1e797700 10 mgrc shutdown 2023-09-30T01:58:18.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.965+0000 7f8c1e797700 1 -- 172.21.15.55:0/1184900313 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f8bfc08e8e0 msgr2=0x7f8bfc090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:18.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.965+0000 7f8c1e797700 1 --2- 172.21.15.55:0/1184900313 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f8bfc08e8e0 0x7f8bfc090d90 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f8c0800adc0 tx=0x7f8c08006f90 comp rx=0 tx=0).stop 2023-09-30T01:58:18.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.965+0000 7f8c1e797700 1 -- 172.21.15.55:0/1184900313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1813d770 msgr2=0x7f8c18150510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:18.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.965+0000 7f8c1e797700 1 --2- 172.21.15.55:0/1184900313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1813d770 0x7f8c18150510 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f8c10009880 tx=0x7f8c10018000 comp rx=0 tx=0).stop 2023-09-30T01:58:18.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.965+0000 7f8c1e797700 1 -- 172.21.15.55:0/1184900313 shutdown_connections 2023-09-30T01:58:18.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.965+0000 7f8c1e797700 1 --2- 172.21.15.55:0/1184900313 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f8bfc08e8e0 0x7f8bfc090d90 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:18.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.965+0000 7f8c1e797700 1 --2- 172.21.15.55:0/1184900313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f8c1813d770 0x7f8c18150510 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:18.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.965+0000 7f8c1e797700 1 --2- 172.21.15.55:0/1184900313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8c180a4bc0 0x7f8c1814ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:18.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.965+0000 7f8c1e797700 1 --2- 172.21.15.55:0/1184900313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8c1806c360 0x7f8c1813b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:18.968 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.965+0000 7f8c1e797700 1 -- 172.21.15.55:0/1184900313 >> 172.21.15.55:0/1184900313 conn(0x7f8c180b23d0 msgr2=0x7f8c18141390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:18.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.965+0000 7f8c1e797700 1 -- 172.21.15.55:0/1184900313 shutdown_connections 2023-09-30T01:58:18.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:18.965+0000 7f8c1e797700 1 -- 172.21.15.55:0/1184900313 wait complete. 2023-09-30T01:58:21.980 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:22.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc483fff700 1 Processor -- start 2023-09-30T01:58:22.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc483fff700 1 -- start start 2023-09-30T01:58:22.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc483fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4840a4990 0x7fc4840aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:22.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc483fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc48413a750 0x7fc48409f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:22.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc483fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4840af120 con 0x7fc4840a4d60 2023-09-30T01:58:22.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc483fff700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc48409f8b0 con 0x7fc48413a750 2023-09-30T01:58:22.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc483fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4840af5b0 con 0x7fc4840a4990 2023-09-30T01:58:22.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc4837fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc48413a750 0x7fc48409f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:22.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc4837fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc48413a750 0x7fc48409f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49782/0 (socket says 172.21.15.55:49782) 2023-09-30T01:58:22.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc4837fe700 1 -- 172.21.15.55:0/1816436544 learned_addr learned my addr 172.21.15.55:0/1816436544 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:22.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc482ffd700 1 --2- 172.21.15.55:0/1816436544 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4840a4990 0x7fc4840aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:22.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc4837fe700 1 -- 172.21.15.55:0/1816436544 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4840a4990 msgr2=0x7fc4840aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:22.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc4837fe700 1 --2- 172.21.15.55:0/1816436544 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4840a4990 0x7fc4840aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:22.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc4837fe700 1 -- 172.21.15.55:0/1816436544 >> v1:172.21.15.133:6789/0 conn(0x7fc4840a4d60 legacy=0x7fc4840a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:22.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc4837fe700 1 -- 172.21.15.55:0/1816436544 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc48409fb10 con 0x7fc48413a750 2023-09-30T01:58:22.096 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc4837fe700 1 --2- 172.21.15.55:0/1816436544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48413a750 0x7fc48409f370 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0099b0 tx=0x7fc47c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11881c2eb7c44493 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:22.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc481ffb700 1 -- 172.21.15.55:0/1816436544 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c009ea0 con 0x7fc48413a750 2023-09-30T01:58:22.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc481ffb700 1 -- 172.21.15.55:0/1816436544 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc47c00b860 con 0x7fc48413a750 2023-09-30T01:58:22.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc481ffb700 1 -- 172.21.15.55:0/1816436544 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47c00bc00 con 0x7fc48413a750 2023-09-30T01:58:22.097 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc483fff700 1 -- 172.21.15.55:0/1816436544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48413a750 msgr2=0x7fc48409f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:22.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc483fff700 1 --2- 172.21.15.55:0/1816436544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48413a750 0x7fc48409f370 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fc47c0099b0 tx=0x7fc47c009250 comp rx=0 tx=0).stop 2023-09-30T01:58:22.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc483fff700 1 -- 172.21.15.55:0/1816436544 shutdown_connections 2023-09-30T01:58:22.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc483fff700 1 --2- 172.21.15.55:0/1816436544 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48413a750 0x7fc48409f370 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:22.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc483fff700 1 --2- 172.21.15.55:0/1816436544 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4840a4990 0x7fc4840aeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:22.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.093+0000 7fc483fff700 1 -- 172.21.15.55:0/1816436544 >> 172.21.15.55:0/1816436544 conn(0x7fc4840b23d0 msgr2=0x7fc4840b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:22.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc483fff700 1 -- 172.21.15.55:0/1816436544 shutdown_connections 2023-09-30T01:58:22.098 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc483fff700 1 -- 172.21.15.55:0/1816436544 wait complete. 2023-09-30T01:58:22.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc483fff700 1 Processor -- start 2023-09-30T01:58:22.099 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc483fff700 1 -- start start 2023-09-30T01:58:22.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc483fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4840a4990 0x7fc484147690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:22.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc483fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840a4d60 0x7fc484137b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:22.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc483fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48413a750 0x7fc484138060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:22.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc483fff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48406bad0 con 0x7fc48413a750 2023-09-30T01:58:22.100 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc483fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc48406e920 con 0x7fc4840a4d60 2023-09-30T01:58:22.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc483fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc48406b810 con 0x7fc4840a4990 2023-09-30T01:58:22.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc482ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4840a4990 0x7fc484147690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:22.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc4837fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48413a750 0x7fc484138060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:22.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc482ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4840a4990 0x7fc484147690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:42434/0 (socket says 172.21.15.55:42434) 2023-09-30T01:58:22.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc4837fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48413a750 0x7fc484138060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49788/0 (socket says 172.21.15.55:49788) 2023-09-30T01:58:22.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc482ffd700 1 -- 172.21.15.55:0/3360257877 learned_addr learned my addr 172.21.15.55:0/3360257877 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:22.101 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc4827fc700 1 --2- 172.21.15.55:0/3360257877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840a4d60 0x7fc484137b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:22.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc482ffd700 1 -- 172.21.15.55:0/3360257877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840a4d60 msgr2=0x7fc484137b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:22.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc482ffd700 1 --2- 172.21.15.55:0/3360257877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840a4d60 0x7fc484137b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:22.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc482ffd700 1 -- 172.21.15.55:0/3360257877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48413a750 msgr2=0x7fc484138060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:22.102 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc482ffd700 1 --2- 172.21.15.55:0/3360257877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48413a750 0x7fc484138060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:22.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.097+0000 7fc482ffd700 1 -- 172.21.15.55:0/3360257877 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc47c0094f0 con 0x7fc4840a4990 2023-09-30T01:58:22.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.101+0000 7fc482ffd700 1 --2- 172.21.15.55:0/3360257877 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4840a4990 0x7fc484147690 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00e930 tx=0x7fc46c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:22.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.101+0000 7fc47affd700 1 -- 172.21.15.55:0/3360257877 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c013680 con 0x7fc4840a4990 2023-09-30T01:58:22.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.101+0000 7fc47affd700 1 -- 172.21.15.55:0/3360257877 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc46c0137e0 con 0x7fc4840a4990 2023-09-30T01:58:22.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.101+0000 7fc483fff700 1 -- 172.21.15.55:0/3360257877 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc48406e0a0 con 0x7fc4840a4990 2023-09-30T01:58:22.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.101+0000 7fc47affd700 1 -- 172.21.15.55:0/3360257877 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc46c013b80 con 0x7fc4840a4990 2023-09-30T01:58:22.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.101+0000 7fc483fff700 1 -- 172.21.15.55:0/3360257877 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc484138710 con 0x7fc4840a4990 2023-09-30T01:58:22.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.101+0000 7fc483fff700 1 -- 172.21.15.55:0/3360257877 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc484064440 con 0x7fc4840a4990 2023-09-30T01:58:22.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.101+0000 7fc47affd700 1 -- 172.21.15.55:0/3360257877 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc46c00c3e0 con 0x7fc4840a4990 2023-09-30T01:58:22.104 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.101+0000 7fc47affd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:22.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.105+0000 7fc47affd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:22.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.105+0000 7fc47affd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:22.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.105+0000 7fc47affd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:22.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.105+0000 7fc47affd700 1 --2- 172.21.15.55:0/3360257877 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc46808e8b0 0x7fc468090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:22.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.105+0000 7fc4827fc700 1 --2- 172.21.15.55:0/3360257877 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc46808e8b0 0x7fc468090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:22.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.105+0000 7fc47affd700 1 -- 172.21.15.55:0/3360257877 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fc46c0b50d0 con 0x7fc4840a4990 2023-09-30T01:58:22.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.105+0000 7fc4827fc700 1 --2- 172.21.15.55:0/3360257877 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc46808e8b0 0x7fc468090d60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc48409e2e0 tx=0x7fc474000f40 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:22.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.109+0000 7fc47affd700 1 -- 172.21.15.55:0/3360257877 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc46c085b00 con 0x7fc4840a4990 2023-09-30T01:58:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.301+0000 7fc483fff700 1 -- 172.21.15.55:0/3360257877 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc48409fdd0 con 0x7fc4840a4990 2023-09-30T01:58:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.301+0000 7fc47affd700 1 -- 172.21.15.55:0/3360257877 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fc46c089120 con 0x7fc4840a4990 2023-09-30T01:58:22.305 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:22.305 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:22.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.305+0000 7fc483fff700 10 mgrc shutdown 2023-09-30T01:58:22.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.305+0000 7fc483fff700 1 -- 172.21.15.55:0/3360257877 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc46808e8b0 msgr2=0x7fc468090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:22.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.305+0000 7fc483fff700 1 --2- 172.21.15.55:0/3360257877 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc46808e8b0 0x7fc468090d60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fc48409e2e0 tx=0x7fc474000f40 comp rx=0 tx=0).stop 2023-09-30T01:58:22.309 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.305+0000 7fc483fff700 1 -- 172.21.15.55:0/3360257877 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4840a4990 msgr2=0x7fc484147690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.305+0000 7fc483fff700 1 --2- 172.21.15.55:0/3360257877 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4840a4990 0x7fc484147690 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fc46c00e930 tx=0x7fc46c0091a0 comp rx=0 tx=0).stop 2023-09-30T01:58:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.305+0000 7fc483fff700 1 -- 172.21.15.55:0/3360257877 shutdown_connections 2023-09-30T01:58:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.309+0000 7fc483fff700 1 --2- 172.21.15.55:0/3360257877 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc48413a750 0x7fc484138060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.309+0000 7fc483fff700 1 --2- 172.21.15.55:0/3360257877 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc4840a4d60 0x7fc484137b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.309+0000 7fc483fff700 1 --2- 172.21.15.55:0/3360257877 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc46808e8b0 0x7fc468090d60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.309+0000 7fc483fff700 1 --2- 172.21.15.55:0/3360257877 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4840a4990 0x7fc484147690 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.309+0000 7fc483fff700 1 -- 172.21.15.55:0/3360257877 >> 172.21.15.55:0/3360257877 conn(0x7fc4840b23d0 msgr2=0x7fc4840a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.309+0000 7fc483fff700 1 -- 172.21.15.55:0/3360257877 shutdown_connections 2023-09-30T01:58:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:22.309+0000 7fc483fff700 1 -- 172.21.15.55:0/3360257877 wait complete. 2023-09-30T01:58:25.322 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:25.436 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.433+0000 7fdb212fe700 1 Processor -- start 2023-09-30T01:58:25.437 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.433+0000 7fdb212fe700 1 -- start start 2023-09-30T01:58:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb212fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb1c0a4990 0x7fdb1c0aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb212fe700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1c0af120 con 0x7fdb1c13a750 2023-09-30T01:58:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb212fe700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1c0af5b0 con 0x7fdb1c0a4d60 2023-09-30T01:58:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb212fe700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c09fb10 con 0x7fdb1c0a4990 2023-09-30T01:58:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb1bfff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb1c0a4990 0x7fdb1c0aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:25.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb1bfff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb1c0a4990 0x7fdb1c0aeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:42442/0 (socket says 172.21.15.55:42442) 2023-09-30T01:58:25.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb1bfff700 1 -- 172.21.15.55:0/2146105006 learned_addr learned my addr 172.21.15.55:0/2146105006 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:25.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb1bfff700 1 -- 172.21.15.55:0/2146105006 >> v1:172.21.15.133:6789/0 conn(0x7fdb1c0a4d60 legacy=0x7fdb1c0a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:25.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb1bfff700 1 -- 172.21.15.55:0/2146105006 >> v1:172.21.15.55:6789/0 conn(0x7fdb1c13a750 legacy=0x7fdb1c14ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:25.439 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb1bfff700 1 -- 172.21.15.55:0/2146105006 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1c09fdd0 con 0x7fdb1c0a4990 2023-09-30T01:58:25.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb1bfff700 1 --2- 172.21.15.55:0/2146105006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb1c0a4990 0x7fdb1c0aeb90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009f50 tx=0x7fdb14009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=876431e86882bd21 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:25.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb1affd700 1 -- 172.21.15.55:0/2146105006 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb1400e070 con 0x7fdb1c0a4990 2023-09-30T01:58:25.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb1affd700 1 -- 172.21.15.55:0/2146105006 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb1400bab0 con 0x7fdb1c0a4990 2023-09-30T01:58:25.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb1affd700 1 -- 172.21.15.55:0/2146105006 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb140092e0 con 0x7fdb1c0a4990 2023-09-30T01:58:25.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb212fe700 1 -- 172.21.15.55:0/2146105006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb1c0a4990 msgr2=0x7fdb1c0aeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:25.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb212fe700 1 --2- 172.21.15.55:0/2146105006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb1c0a4990 0x7fdb1c0aeb90 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009f50 tx=0x7fdb14009840 comp rx=0 tx=0).stop 2023-09-30T01:58:25.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb212fe700 1 -- 172.21.15.55:0/2146105006 shutdown_connections 2023-09-30T01:58:25.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb212fe700 1 --2- 172.21.15.55:0/2146105006 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb1c0a4990 0x7fdb1c0aeb90 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:25.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb212fe700 1 -- 172.21.15.55:0/2146105006 >> 172.21.15.55:0/2146105006 conn(0x7fdb1c0b23d0 msgr2=0x7fdb1c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:25.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb212fe700 1 -- 172.21.15.55:0/2146105006 shutdown_connections 2023-09-30T01:58:25.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.437+0000 7fdb212fe700 1 -- 172.21.15.55:0/2146105006 wait complete. 2023-09-30T01:58:25.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb212fe700 1 Processor -- start 2023-09-30T01:58:25.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb212fe700 1 -- start start 2023-09-30T01:58:25.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb212fe700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb1c0a4990 0x7fdb1c1371f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:25.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb212fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb1c0a4d60 0x7fdb1c157530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:25.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb212fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb1c13a750 0x7fdb1c096d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:25.444 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb212fe700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c098ec0 con 0x7fdb1c13a750 2023-09-30T01:58:25.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb212fe700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c06e4e0 con 0x7fdb1c0a4990 2023-09-30T01:58:25.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb212fe700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1c06f130 con 0x7fdb1c0a4d60 2023-09-30T01:58:25.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb1b7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb1c0a4d60 0x7fdb1c157530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:25.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb1b7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb1c0a4d60 0x7fdb1c157530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:42446/0 (socket says 172.21.15.55:42446) 2023-09-30T01:58:25.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb1b7fe700 1 -- 172.21.15.55:0/405710967 learned_addr learned my addr 172.21.15.55:0/405710967 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:25.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb20afd700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb1c13a750 0x7fdb1c096d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:25.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb1bfff700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb1c0a4990 0x7fdb1c1371f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:25.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb1b7fe700 1 -- 172.21.15.55:0/405710967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb1c0a4990 msgr2=0x7fdb1c1371f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:25.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb1b7fe700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb1c0a4990 0x7fdb1c1371f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:25.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb1b7fe700 1 -- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb1c13a750 msgr2=0x7fdb1c096d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:25.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb1b7fe700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb1c13a750 0x7fdb1c096d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:25.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb1b7fe700 1 -- 172.21.15.55:0/405710967 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb14009ae0 con 0x7fdb1c0a4d60 2023-09-30T01:58:25.446 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb20afd700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb1c13a750 0x7fdb1c096d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:58:25.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb1bfff700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb1c0a4990 0x7fdb1c1371f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:58:25.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb1b7fe700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb1c0a4d60 0x7fdb1c157530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400c7f0 tx=0x7fdb04007f50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:25.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb13fff700 1 -- 172.21.15.55:0/405710967 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04011590 con 0x7fdb1c0a4d60 2023-09-30T01:58:25.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb13fff700 1 -- 172.21.15.55:0/405710967 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb040116f0 con 0x7fdb1c0a4d60 2023-09-30T01:58:25.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb212fe700 1 -- 172.21.15.55:0/405710967 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb1c158040 con 0x7fdb1c0a4d60 2023-09-30T01:58:25.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb13fff700 1 -- 172.21.15.55:0/405710967 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb04011ab0 con 0x7fdb1c0a4d60 2023-09-30T01:58:25.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.441+0000 7fdb212fe700 1 -- 172.21.15.55:0/405710967 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb1c095b00 con 0x7fdb1c0a4d60 2023-09-30T01:58:25.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.445+0000 7fdb212fe700 1 -- 172.21.15.55:0/405710967 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb1c064440 con 0x7fdb1c0a4d60 2023-09-30T01:58:25.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.445+0000 7fdb13fff700 1 -- 172.21.15.55:0/405710967 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fdb0401b3b0 con 0x7fdb1c0a4d60 2023-09-30T01:58:25.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.445+0000 7fdb13fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:25.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.449+0000 7fdb13fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:25.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.449+0000 7fdb13fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:25.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.449+0000 7fdb13fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:25.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.449+0000 7fdb13fff700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdafc08e8b0 0x7fdafc090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:25.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.449+0000 7fdb1bfff700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdafc08e8b0 0x7fdafc090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:25.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.449+0000 7fdb13fff700 1 -- 172.21.15.55:0/405710967 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fdb040b3e90 con 0x7fdb1c0a4d60 2023-09-30T01:58:25.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.449+0000 7fdb1bfff700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdafc08e8b0 0x7fdafc090d60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009ea0 tx=0x7fdb14018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:25.457 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.457+0000 7fdb13fff700 1 -- 172.21.15.55:0/405710967 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdb04084790 con 0x7fdb1c0a4d60 2023-09-30T01:58:25.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.653+0000 7fdb212fe700 1 -- 172.21.15.55:0/405710967 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdb1c0680b0 con 0x7fdb1c0a4d60 2023-09-30T01:58:25.654 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.653+0000 7fdb13fff700 1 -- 172.21.15.55:0/405710967 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fdb040b5100 con 0x7fdb1c0a4d60 2023-09-30T01:58:25.655 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:25.655 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.657+0000 7fdb212fe700 10 mgrc shutdown 2023-09-30T01:58:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.657+0000 7fdb212fe700 1 -- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdafc08e8b0 msgr2=0x7fdafc090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.657+0000 7fdb212fe700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdafc08e8b0 0x7fdafc090d60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdb14009ea0 tx=0x7fdb14018000 comp rx=0 tx=0).stop 2023-09-30T01:58:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.657+0000 7fdb212fe700 1 -- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb1c0a4d60 msgr2=0x7fdb1c157530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.657+0000 7fdb212fe700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb1c0a4d60 0x7fdb1c157530 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdb0400c7f0 tx=0x7fdb04007f50 comp rx=0 tx=0).stop 2023-09-30T01:58:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.657+0000 7fdb212fe700 1 -- 172.21.15.55:0/405710967 shutdown_connections 2023-09-30T01:58:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.657+0000 7fdb212fe700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdb1c13a750 0x7fdb1c096d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.657+0000 7fdb212fe700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdafc08e8b0 0x7fdafc090d60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.657+0000 7fdb212fe700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdb1c0a4d60 0x7fdb1c157530 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.657+0000 7fdb212fe700 1 --2- 172.21.15.55:0/405710967 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdb1c0a4990 0x7fdb1c1371f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.657+0000 7fdb212fe700 1 -- 172.21.15.55:0/405710967 >> 172.21.15.55:0/405710967 conn(0x7fdb1c0b23d0 msgr2=0x7fdb1c0a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:25.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.657+0000 7fdb212fe700 1 -- 172.21.15.55:0/405710967 shutdown_connections 2023-09-30T01:58:25.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:25.657+0000 7fdb212fe700 1 -- 172.21.15.55:0/405710967 wait complete. 2023-09-30T01:58:28.676 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:28.787 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.785+0000 7fdc532e7700 1 Processor -- start 2023-09-30T01:58:28.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.785+0000 7fdc532e7700 1 -- start start 2023-09-30T01:58:28.788 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.785+0000 7fdc532e7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc4c0a7580 0x7fdc4c0a8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:28.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.785+0000 7fdc532e7700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc4c0702f0 0x7fdc4c13e1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:28.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.785+0000 7fdc532e7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc4c0a8f90 con 0x7fdc4c06ff20 2023-09-30T01:58:28.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.785+0000 7fdc532e7700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc4c13dcc0 con 0x7fdc4c0a7580 2023-09-30T01:58:28.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.785+0000 7fdc532e7700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0a7db0 con 0x7fdc4c0702f0 2023-09-30T01:58:28.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.785+0000 7fdc50882700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc4c0a7580 0x7fdc4c0a8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:28.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.785+0000 7fdc50882700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdc4c0a7580 0x7fdc4c0a8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49810/0 (socket says 172.21.15.55:49810) 2023-09-30T01:58:28.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.785+0000 7fdc50882700 1 -- 172.21.15.55:0/1367660876 learned_addr learned my addr 172.21.15.55:0/1367660876 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:28.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.785+0000 7fdc51884700 1 --2- 172.21.15.55:0/1367660876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc4c0702f0 0x7fdc4c13e1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc51884700 1 -- 172.21.15.55:0/1367660876 >> v2:172.21.15.55:3300/0 conn(0x7fdc4c0a7580 msgr2=0x7fdc4c0a8a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc51884700 1 --2- 172.21.15.55:0/1367660876 >> v2:172.21.15.55:3300/0 conn(0x7fdc4c0a7580 0x7fdc4c0a8a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc51884700 1 -- 172.21.15.55:0/1367660876 >> v1:172.21.15.133:6789/0 conn(0x7fdc4c06ff20 legacy=0x7fdc4c0a6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc51884700 1 -- 172.21.15.55:0/1367660876 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c13dee0 con 0x7fdc4c0702f0 2023-09-30T01:58:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc50882700 1 --2- 172.21.15.55:0/1367660876 >> v2:172.21.15.55:3300/0 conn(0x7fdc4c0a7580 0x7fdc4c0a8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:58:28.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc51884700 1 --2- 172.21.15.55:0/1367660876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc4c0702f0 0x7fdc4c13e1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009e60 tx=0x7fdc44009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e420757f0d85afd9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:28.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc43fff700 1 -- 172.21.15.55:0/1367660876 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4400e070 con 0x7fdc4c0702f0 2023-09-30T01:58:28.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc43fff700 1 -- 172.21.15.55:0/1367660876 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4400bb60 con 0x7fdc4c0702f0 2023-09-30T01:58:28.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc43fff700 1 -- 172.21.15.55:0/1367660876 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc44012430 con 0x7fdc4c0702f0 2023-09-30T01:58:28.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc532e7700 1 -- 172.21.15.55:0/1367660876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc4c0702f0 msgr2=0x7fdc4c13e1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:28.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc532e7700 1 --2- 172.21.15.55:0/1367660876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc4c0702f0 0x7fdc4c13e1a0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009e60 tx=0x7fdc44009780 comp rx=0 tx=0).stop 2023-09-30T01:58:28.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc532e7700 1 -- 172.21.15.55:0/1367660876 shutdown_connections 2023-09-30T01:58:28.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc532e7700 1 --2- 172.21.15.55:0/1367660876 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc4c0702f0 0x7fdc4c13e1a0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:28.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc532e7700 1 --2- 172.21.15.55:0/1367660876 >> v2:172.21.15.55:3300/0 conn(0x7fdc4c0a7580 0x7fdc4c0a8a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:28.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc532e7700 1 -- 172.21.15.55:0/1367660876 >> 172.21.15.55:0/1367660876 conn(0x7fdc4c0b2f00 msgr2=0x7fdc4c0b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:28.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc532e7700 1 -- 172.21.15.55:0/1367660876 shutdown_connections 2023-09-30T01:58:28.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc532e7700 1 -- 172.21.15.55:0/1367660876 wait complete. 2023-09-30T01:58:28.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc532e7700 1 Processor -- start 2023-09-30T01:58:28.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.789+0000 7fdc532e7700 1 -- start start 2023-09-30T01:58:28.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc532e7700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc4c06ff20 0x7fdc4c14fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:28.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc532e7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0702f0 0x7fdc4c06c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:28.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc532e7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc4c0a7580 0x7fdc4c150470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:28.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc532e7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c06cdc0 con 0x7fdc4c0702f0 2023-09-30T01:58:28.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc532e7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0a4750 con 0x7fdc4c0a7580 2023-09-30T01:58:28.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc532e7700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4c0b1a10 con 0x7fdc4c06ff20 2023-09-30T01:58:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc51083700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc4c06ff20 0x7fdc4c14fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc50882700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0702f0 0x7fdc4c06c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc51083700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc4c06ff20 0x7fdc4c14fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:42476/0 (socket says 172.21.15.55:42476) 2023-09-30T01:58:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc50882700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0702f0 0x7fdc4c06c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:49812/0 (socket says 172.21.15.55:49812) 2023-09-30T01:58:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc51083700 1 -- 172.21.15.55:0/660282869 learned_addr learned my addr 172.21.15.55:0/660282869 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc51884700 1 --2- 172.21.15.55:0/660282869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc4c0a7580 0x7fdc4c150470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc51083700 1 -- 172.21.15.55:0/660282869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc4c0a7580 msgr2=0x7fdc4c150470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc51083700 1 --2- 172.21.15.55:0/660282869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc4c0a7580 0x7fdc4c150470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc51083700 1 -- 172.21.15.55:0/660282869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0702f0 msgr2=0x7fdc4c06c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc51083700 1 --2- 172.21.15.55:0/660282869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0702f0 0x7fdc4c06c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc51083700 1 -- 172.21.15.55:0/660282869 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc480094f0 con 0x7fdc4c06ff20 2023-09-30T01:58:28.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc51884700 1 --2- 172.21.15.55:0/660282869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc4c0a7580 0x7fdc4c150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:58:28.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc51083700 1 --2- 172.21.15.55:0/660282869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc4c06ff20 0x7fdc4c14fc40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00c590 tx=0x7fdc3c00c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:28.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc417fa700 1 -- 172.21.15.55:0/660282869 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c011590 con 0x7fdc4c06ff20 2023-09-30T01:58:28.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc417fa700 1 -- 172.21.15.55:0/660282869 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc3c011710 con 0x7fdc4c06ff20 2023-09-30T01:58:28.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc532e7700 1 -- 172.21.15.55:0/660282869 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc44009a20 con 0x7fdc4c06ff20 2023-09-30T01:58:28.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc417fa700 1 -- 172.21.15.55:0/660282869 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc3c011ad0 con 0x7fdc4c06ff20 2023-09-30T01:58:28.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.793+0000 7fdc532e7700 1 -- 172.21.15.55:0/660282869 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc4c0b2100 con 0x7fdc4c06ff20 2023-09-30T01:58:28.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.797+0000 7fdc532e7700 1 -- 172.21.15.55:0/660282869 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc4c1501d0 con 0x7fdc4c06ff20 2023-09-30T01:58:28.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.797+0000 7fdc417fa700 1 -- 172.21.15.55:0/660282869 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fdc3c01b3b0 con 0x7fdc4c06ff20 2023-09-30T01:58:28.799 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.797+0000 7fdc417fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:28.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.797+0000 7fdc417fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:28.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.797+0000 7fdc417fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:28.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.797+0000 7fdc417fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:28.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.797+0000 7fdc417fa700 1 --2- 172.21.15.55:0/660282869 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdc3008e8b0 0x7fdc30090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:28.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.797+0000 7fdc417fa700 1 -- 172.21.15.55:0/660282869 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fdc3c0b3c40 con 0x7fdc4c06ff20 2023-09-30T01:58:28.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.797+0000 7fdc50882700 1 --2- 172.21.15.55:0/660282869 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdc3008e8b0 0x7fdc30090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:28.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.797+0000 7fdc50882700 1 --2- 172.21.15.55:0/660282869 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdc3008e8b0 0x7fdc30090d60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0b2e00 tx=0x7fdc48009250 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:28.806 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.805+0000 7fdc417fa700 1 -- 172.21.15.55:0/660282869 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdc4c1501d0 con 0x7fdc4c06ff20 2023-09-30T01:58:28.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.993+0000 7fdc532e7700 1 -- 172.21.15.55:0/660282869 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdc4c0a8f90 con 0x7fdc4c06ff20 2023-09-30T01:58:28.997 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.997+0000 7fdc417fa700 1 -- 172.21.15.55:0/660282869 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fdc4c0a8f90 con 0x7fdc4c06ff20 2023-09-30T01:58:28.998 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:28.998 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:29.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.997+0000 7fdc532e7700 10 mgrc shutdown 2023-09-30T01:58:29.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.997+0000 7fdc532e7700 1 -- 172.21.15.55:0/660282869 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdc3008e8b0 msgr2=0x7fdc30090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:29.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.997+0000 7fdc532e7700 1 --2- 172.21.15.55:0/660282869 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdc3008e8b0 0x7fdc30090d60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c0b2e00 tx=0x7fdc48009250 comp rx=0 tx=0).stop 2023-09-30T01:58:29.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.997+0000 7fdc532e7700 1 -- 172.21.15.55:0/660282869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc4c06ff20 msgr2=0x7fdc4c14fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:29.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.997+0000 7fdc532e7700 1 --2- 172.21.15.55:0/660282869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc4c06ff20 0x7fdc4c14fc40 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c00c590 tx=0x7fdc3c00c8a0 comp rx=0 tx=0).stop 2023-09-30T01:58:29.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.997+0000 7fdc532e7700 1 -- 172.21.15.55:0/660282869 shutdown_connections 2023-09-30T01:58:29.000 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.997+0000 7fdc532e7700 1 --2- 172.21.15.55:0/660282869 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdc4c0a7580 0x7fdc4c150470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:29.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.997+0000 7fdc532e7700 1 --2- 172.21.15.55:0/660282869 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdc4c0702f0 0x7fdc4c06c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:29.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.997+0000 7fdc532e7700 1 --2- 172.21.15.55:0/660282869 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdc3008e8b0 0x7fdc30090d60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:29.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.997+0000 7fdc532e7700 1 --2- 172.21.15.55:0/660282869 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdc4c06ff20 0x7fdc4c14fc40 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:29.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.997+0000 7fdc532e7700 1 -- 172.21.15.55:0/660282869 >> 172.21.15.55:0/660282869 conn(0x7fdc4c0b2f00 msgr2=0x7fdc4c0a8540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:29.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.997+0000 7fdc532e7700 1 -- 172.21.15.55:0/660282869 shutdown_connections 2023-09-30T01:58:29.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:28.997+0000 7fdc532e7700 1 -- 172.21.15.55:0/660282869 wait complete. 2023-09-30T01:58:32.013 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa28f187700 1 Processor -- start 2023-09-30T01:58:32.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa28f187700 1 -- start start 2023-09-30T01:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa28f187700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa2880675c0 0x7fa2880a9840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa28f187700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa2880a88d0 0x7fa2880a6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa28f187700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa288067990 con 0x7fa2880a7330 2023-09-30T01:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa28f187700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2880a9d80 con 0x7fa2880a88d0 2023-09-30T01:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa28f187700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2880aa240 con 0x7fa2880675c0 2023-09-30T01:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa287fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa2880a88d0 0x7fa2880a6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa287fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa2880a88d0 0x7fa2880a6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42436/0 (socket says 172.21.15.55:42436) 2023-09-30T01:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa287fff700 1 -- 172.21.15.55:0/1521668752 learned_addr learned my addr 172.21.15.55:0/1521668752 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa28cf23700 1 --2- 172.21.15.55:0/1521668752 >> v2:172.21.15.133:3300/0 conn(0x7fa2880675c0 0x7fa2880a9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa287fff700 1 -- 172.21.15.55:0/1521668752 >> v2:172.21.15.133:3300/0 conn(0x7fa2880675c0 msgr2=0x7fa2880a9840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:32.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa287fff700 1 --2- 172.21.15.55:0/1521668752 >> v2:172.21.15.133:3300/0 conn(0x7fa2880675c0 0x7fa2880a9840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa287fff700 1 -- 172.21.15.55:0/1521668752 >> v1:172.21.15.133:6789/0 conn(0x7fa2880a7330 legacy=0x7fa288133d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa287fff700 1 -- 172.21.15.55:0/1521668752 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2880a7830 con 0x7fa2880a88d0 2023-09-30T01:58:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.125+0000 7fa28cf23700 1 --2- 172.21.15.55:0/1521668752 >> v2:172.21.15.133:3300/0 conn(0x7fa2880675c0 0x7fa2880a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T01:58:32.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.129+0000 7fa287fff700 1 --2- 172.21.15.55:0/1521668752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880a88d0 0x7fa2880a6df0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa2740099b0 tx=0x7fa274009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f59e95d2268592c8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.129+0000 7fa2877fe700 1 -- 172.21.15.55:0/1521668752 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400b7e0 con 0x7fa2880a88d0 2023-09-30T01:58:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.129+0000 7fa2877fe700 1 -- 172.21.15.55:0/1521668752 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa27400b940 con 0x7fa2880a88d0 2023-09-30T01:58:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.129+0000 7fa2877fe700 1 -- 172.21.15.55:0/1521668752 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa27400bce0 con 0x7fa2880a88d0 2023-09-30T01:58:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.129+0000 7fa28f187700 1 -- 172.21.15.55:0/1521668752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880a88d0 msgr2=0x7fa2880a6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.129+0000 7fa28f187700 1 --2- 172.21.15.55:0/1521668752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880a88d0 0x7fa2880a6df0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fa2740099b0 tx=0x7fa274009250 comp rx=0 tx=0).stop 2023-09-30T01:58:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.129+0000 7fa28f187700 1 -- 172.21.15.55:0/1521668752 shutdown_connections 2023-09-30T01:58:32.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.129+0000 7fa28f187700 1 --2- 172.21.15.55:0/1521668752 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880a88d0 0x7fa2880a6df0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.129+0000 7fa28f187700 1 --2- 172.21.15.55:0/1521668752 >> v2:172.21.15.133:3300/0 conn(0x7fa2880675c0 0x7fa2880a9840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.129+0000 7fa28f187700 1 -- 172.21.15.55:0/1521668752 >> 172.21.15.55:0/1521668752 conn(0x7fa288062e80 msgr2=0x7fa288063250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.129+0000 7fa28f187700 1 -- 172.21.15.55:0/1521668752 shutdown_connections 2023-09-30T01:58:32.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.129+0000 7fa28f187700 1 -- 172.21.15.55:0/1521668752 wait complete. 2023-09-30T01:58:32.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28f187700 1 Processor -- start 2023-09-30T01:58:32.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28f187700 1 -- start start 2023-09-30T01:58:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28f187700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880675c0 0x7fa2880b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28f187700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2880a7330 0x7fa288130450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28f187700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2880a88d0 0x7fa2880b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28f187700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2880b08c0 con 0x7fa2880675c0 2023-09-30T01:58:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28f187700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2880b2560 con 0x7fa2880a7330 2023-09-30T01:58:32.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28f187700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2880b2820 con 0x7fa2880a88d0 2023-09-30T01:58:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28cf23700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880675c0 0x7fa2880b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28d724700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2880a88d0 0x7fa2880b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28cf23700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880675c0 0x7fa2880b1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42438/0 (socket says 172.21.15.55:42438) 2023-09-30T01:58:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28cf23700 1 -- 172.21.15.55:0/856896744 learned_addr learned my addr 172.21.15.55:0/856896744 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:32.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa287fff700 1 --2- 172.21.15.55:0/856896744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2880a7330 0x7fa288130450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28d724700 1 -- 172.21.15.55:0/856896744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2880a7330 msgr2=0x7fa288130450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28d724700 1 --2- 172.21.15.55:0/856896744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2880a7330 0x7fa288130450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28d724700 1 -- 172.21.15.55:0/856896744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880675c0 msgr2=0x7fa2880b1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28d724700 1 --2- 172.21.15.55:0/856896744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880675c0 0x7fa2880b1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28d724700 1 -- 172.21.15.55:0/856896744 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2740094f0 con 0x7fa2880a88d0 2023-09-30T01:58:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28d724700 1 --2- 172.21.15.55:0/856896744 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2880a88d0 0x7fa2880b0fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa28000c810 tx=0x7fa280002620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:32.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa284ff9700 1 -- 172.21.15.55:0/856896744 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280012630 con 0x7fa2880a88d0 2023-09-30T01:58:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa284ff9700 1 -- 172.21.15.55:0/856896744 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2800127b0 con 0x7fa2880a88d0 2023-09-30T01:58:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28f187700 1 -- 172.21.15.55:0/856896744 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28812fe70 con 0x7fa2880a88d0 2023-09-30T01:58:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa284ff9700 1 -- 172.21.15.55:0/856896744 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa280012b70 con 0x7fa2880a88d0 2023-09-30T01:58:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.133+0000 7fa28f187700 1 -- 172.21.15.55:0/856896744 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2880b1500 con 0x7fa2880a88d0 2023-09-30T01:58:32.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.137+0000 7fa28f187700 1 -- 172.21.15.55:0/856896744 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa288063960 con 0x7fa2880a88d0 2023-09-30T01:58:32.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.137+0000 7fa284ff9700 1 -- 172.21.15.55:0/856896744 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fa28001a3b0 con 0x7fa2880a88d0 2023-09-30T01:58:32.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.137+0000 7fa284ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.137+0000 7fa284ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.141+0000 7fa284ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.141+0000 7fa284ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.141+0000 7fa284ff9700 1 --2- 172.21.15.55:0/856896744 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa26c08e8b0 0x7fa26c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:32.141 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.141+0000 7fa284ff9700 1 -- 172.21.15.55:0/856896744 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fa2800b4430 con 0x7fa2880a88d0 2023-09-30T01:58:32.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.141+0000 7fa28cf23700 1 --2- 172.21.15.55:0/856896744 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa26c08e8b0 0x7fa26c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:32.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.141+0000 7fa28cf23700 1 --2- 172.21.15.55:0/856896744 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa26c08e8b0 0x7fa26c090d60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa27c006fd0 tx=0x7fa27c012040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:32.147 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.145+0000 7fa284ff9700 1 -- 172.21.15.55:0/856896744 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa2800888f0 con 0x7fa2880a88d0 2023-09-30T01:58:32.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.337+0000 7fa28f187700 1 -- 172.21.15.55:0/856896744 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa28804b5c0 con 0x7fa2880a88d0 2023-09-30T01:58:32.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.337+0000 7fa284ff9700 1 -- 172.21.15.55:0/856896744 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa280016080 con 0x7fa2880a88d0 2023-09-30T01:58:32.339 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:32.339 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.341+0000 7fa28f187700 10 mgrc shutdown 2023-09-30T01:58:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.341+0000 7fa28f187700 1 -- 172.21.15.55:0/856896744 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa26c08e8b0 msgr2=0x7fa26c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.341+0000 7fa28f187700 1 --2- 172.21.15.55:0/856896744 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa26c08e8b0 0x7fa26c090d60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa27c006fd0 tx=0x7fa27c012040 comp rx=0 tx=0).stop 2023-09-30T01:58:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.341+0000 7fa28f187700 1 -- 172.21.15.55:0/856896744 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2880a88d0 msgr2=0x7fa2880b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.341+0000 7fa28f187700 1 --2- 172.21.15.55:0/856896744 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2880a88d0 0x7fa2880b0fc0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa28000c810 tx=0x7fa280002620 comp rx=0 tx=0).stop 2023-09-30T01:58:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.341+0000 7fa28f187700 1 -- 172.21.15.55:0/856896744 shutdown_connections 2023-09-30T01:58:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.341+0000 7fa28f187700 1 --2- 172.21.15.55:0/856896744 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa26c08e8b0 0x7fa26c090d60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.341+0000 7fa28f187700 1 --2- 172.21.15.55:0/856896744 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa2880a88d0 0x7fa2880b0fc0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:32.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.341+0000 7fa28f187700 1 --2- 172.21.15.55:0/856896744 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa2880a7330 0x7fa288130450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.341+0000 7fa28f187700 1 --2- 172.21.15.55:0/856896744 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa2880675c0 0x7fa2880b1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.341+0000 7fa28f187700 1 -- 172.21.15.55:0/856896744 >> 172.21.15.55:0/856896744 conn(0x7fa288062e80 msgr2=0x7fa2880b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.341+0000 7fa28f187700 1 -- 172.21.15.55:0/856896744 shutdown_connections 2023-09-30T01:58:32.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:32.341+0000 7fa28f187700 1 -- 172.21.15.55:0/856896744 wait complete. 2023-09-30T01:58:35.354 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.465+0000 7ff8b8dda700 1 Processor -- start 2023-09-30T01:58:35.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.465+0000 7ff8b8dda700 1 -- start start 2023-09-30T01:58:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.465+0000 7ff8b8dda700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8b406af90 0x7ff8b413d060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.465+0000 7ff8b8dda700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b40a1880 con 0x7ff8b413d5a0 2023-09-30T01:58:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.465+0000 7ff8b8dda700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b40a4f90 con 0x7ff8b40a4bc0 2023-09-30T01:58:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.465+0000 7ff8b8dda700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b406b360 con 0x7ff8b406af90 2023-09-30T01:58:35.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.465+0000 7ff8b2ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8b406af90 0x7ff8b413d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:35.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.465+0000 7ff8b2ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8b406af90 0x7ff8b413d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:38668/0 (socket says 172.21.15.55:38668) 2023-09-30T01:58:35.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.465+0000 7ff8b2ffd700 1 -- 172.21.15.55:0/1833549012 learned_addr learned my addr 172.21.15.55:0/1833549012 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:35.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b2ffd700 1 -- 172.21.15.55:0/1833549012 >> v1:172.21.15.133:6789/0 conn(0x7ff8b40a4bc0 legacy=0x7ff8b406c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:35.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b2ffd700 1 -- 172.21.15.55:0/1833549012 >> v1:172.21.15.55:6789/0 conn(0x7ff8b413d5a0 legacy=0x7ff8b41473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:35.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b2ffd700 1 -- 172.21.15.55:0/1833549012 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b40a1ab0 con 0x7ff8b406af90 2023-09-30T01:58:35.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b2ffd700 1 --2- 172.21.15.55:0/1833549012 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8b406af90 0x7ff8b413d060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40099e0 tx=0x7ff8a4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9b9ab0fb23874eb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b27fc700 1 -- 172.21.15.55:0/1833549012 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400b820 con 0x7ff8b406af90 2023-09-30T01:58:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b27fc700 1 -- 172.21.15.55:0/1833549012 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a400b980 con 0x7ff8b406af90 2023-09-30T01:58:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b27fc700 1 -- 172.21.15.55:0/1833549012 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a400bd20 con 0x7ff8b406af90 2023-09-30T01:58:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 -- 172.21.15.55:0/1833549012 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8b406af90 msgr2=0x7ff8b413d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 --2- 172.21.15.55:0/1833549012 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8b406af90 0x7ff8b413d060 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff8a40099e0 tx=0x7ff8a4009250 comp rx=0 tx=0).stop 2023-09-30T01:58:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 -- 172.21.15.55:0/1833549012 shutdown_connections 2023-09-30T01:58:35.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 --2- 172.21.15.55:0/1833549012 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8b406af90 0x7ff8b413d060 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:35.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 -- 172.21.15.55:0/1833549012 >> 172.21.15.55:0/1833549012 conn(0x7ff8b40b23d0 msgr2=0x7ff8b40b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:35.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 -- 172.21.15.55:0/1833549012 shutdown_connections 2023-09-30T01:58:35.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 -- 172.21.15.55:0/1833549012 wait complete. 2023-09-30T01:58:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 Processor -- start 2023-09-30T01:58:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 -- start start 2023-09-30T01:58:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8b406af90 0x7ff8b4098cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8b40a4bc0 0x7ff8b41382d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b413d5a0 0x7ff8b4137410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:35.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b4097fe0 con 0x7ff8b406af90 2023-09-30T01:58:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40991f0 con 0x7ff8b413d5a0 2023-09-30T01:58:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b8dda700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b414f150 con 0x7ff8b40a4bc0 2023-09-30T01:58:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b2ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8b40a4bc0 0x7ff8b41382d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8b406af90 0x7ff8b4098cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b2ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8b40a4bc0 0x7ff8b41382d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:38684/0 (socket says 172.21.15.55:38684) 2023-09-30T01:58:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b2ffd700 1 -- 172.21.15.55:0/3566940922 learned_addr learned my addr 172.21.15.55:0/3566940922 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.469+0000 7ff8b3fff700 1 --2- 172.21.15.55:0/3566940922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b413d5a0 0x7ff8b4137410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff8b2ffd700 1 -- 172.21.15.55:0/3566940922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b413d5a0 msgr2=0x7ff8b4137410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff8b2ffd700 1 --2- 172.21.15.55:0/3566940922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b413d5a0 0x7ff8b4137410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff8b2ffd700 1 -- 172.21.15.55:0/3566940922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8b406af90 msgr2=0x7ff8b4098cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff8b2ffd700 1 --2- 172.21.15.55:0/3566940922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8b406af90 0x7ff8b4098cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:35.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff8b2ffd700 1 -- 172.21.15.55:0/3566940922 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a40094f0 con 0x7ff8b40a4bc0 2023-09-30T01:58:35.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff8b37fe700 1 --2- 172.21.15.55:0/3566940922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8b406af90 0x7ff8b4098cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:58:35.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff8b2ffd700 1 --2- 172.21.15.55:0/3566940922 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8b40a4bc0 0x7ff8b41382d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009290 tx=0x7ff8a4016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:35.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff89b7fe700 1 -- 172.21.15.55:0/3566940922 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a4011e20 con 0x7ff8b40a4bc0 2023-09-30T01:58:35.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff89b7fe700 1 -- 172.21.15.55:0/3566940922 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8a401b470 con 0x7ff8b40a4bc0 2023-09-30T01:58:35.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff89b7fe700 1 -- 172.21.15.55:0/3566940922 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8a401b830 con 0x7ff8b40a4bc0 2023-09-30T01:58:35.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff8b8dda700 1 -- 172.21.15.55:0/3566940922 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b414f410 con 0x7ff8b40a4bc0 2023-09-30T01:58:35.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff8b8dda700 1 -- 172.21.15.55:0/3566940922 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b4138810 con 0x7ff8b40a4bc0 2023-09-30T01:58:35.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff8b8dda700 1 -- 172.21.15.55:0/3566940922 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b4137150 con 0x7ff8b40a4bc0 2023-09-30T01:58:35.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff89b7fe700 1 -- 172.21.15.55:0/3566940922 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7ff8a401bba0 con 0x7ff8b40a4bc0 2023-09-30T01:58:35.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff89b7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:35.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff89b7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:35.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff89b7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:35.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff89b7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:35.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff89b7fe700 1 --2- 172.21.15.55:0/3566940922 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff8a008e830 0x7ff8a0090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.473+0000 7ff89b7fe700 1 -- 172.21.15.55:0/3566940922 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7ff8a40b64d0 con 0x7ff8b40a4bc0 2023-09-30T01:58:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.477+0000 7ff8b37fe700 1 --2- 172.21.15.55:0/3566940922 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff8a008e830 0x7ff8a0090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:35.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.477+0000 7ff8b37fe700 1 --2- 172.21.15.55:0/3566940922 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff8a008e830 0x7ff8a0090ce0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8002e00 tx=0x7ff8a8007ea0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:35.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.481+0000 7ff89b7fe700 1 -- 172.21.15.55:0/3566940922 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff8b4137150 con 0x7ff8b40a4bc0 2023-09-30T01:58:35.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.677+0000 7ff8b8dda700 1 -- 172.21.15.55:0/3566940922 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff8b4137150 con 0x7ff8b40a4bc0 2023-09-30T01:58:35.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.677+0000 7ff89b7fe700 1 -- 172.21.15.55:0/3566940922 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7ff8b4137150 con 0x7ff8b40a4bc0 2023-09-30T01:58:35.680 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:35.680 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:35.682 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.681+0000 7ff8b8dda700 10 mgrc shutdown 2023-09-30T01:58:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.681+0000 7ff8b8dda700 1 -- 172.21.15.55:0/3566940922 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff8a008e830 msgr2=0x7ff8a0090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.681+0000 7ff8b8dda700 1 --2- 172.21.15.55:0/3566940922 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff8a008e830 0x7ff8a0090ce0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff8a8002e00 tx=0x7ff8a8007ea0 comp rx=0 tx=0).stop 2023-09-30T01:58:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.681+0000 7ff8b8dda700 1 -- 172.21.15.55:0/3566940922 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8b40a4bc0 msgr2=0x7ff8b41382d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.681+0000 7ff8b8dda700 1 --2- 172.21.15.55:0/3566940922 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8b40a4bc0 0x7ff8b41382d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff8a4009290 tx=0x7ff8a4016000 comp rx=0 tx=0).stop 2023-09-30T01:58:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.681+0000 7ff8b8dda700 1 -- 172.21.15.55:0/3566940922 shutdown_connections 2023-09-30T01:58:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.681+0000 7ff8b8dda700 1 --2- 172.21.15.55:0/3566940922 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8b413d5a0 0x7ff8b4137410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.681+0000 7ff8b8dda700 1 --2- 172.21.15.55:0/3566940922 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff8a008e830 0x7ff8a0090ce0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.681+0000 7ff8b8dda700 1 --2- 172.21.15.55:0/3566940922 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8b40a4bc0 0x7ff8b41382d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:35.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.681+0000 7ff8b8dda700 1 --2- 172.21.15.55:0/3566940922 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8b406af90 0x7ff8b4098cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:35.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.681+0000 7ff8b8dda700 1 -- 172.21.15.55:0/3566940922 >> 172.21.15.55:0/3566940922 conn(0x7ff8b40b23d0 msgr2=0x7ff8b413ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:35.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.681+0000 7ff8b8dda700 1 -- 172.21.15.55:0/3566940922 shutdown_connections 2023-09-30T01:58:35.684 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:35.681+0000 7ff8b8dda700 1 -- 172.21.15.55:0/3566940922 wait complete. 2023-09-30T01:58:38.695 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:38.810 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b86905700 1 Processor -- start 2023-09-30T01:58:38.811 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b86905700 1 -- start start 2023-09-30T01:58:38.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b86905700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1b800a73f0 0x7f1b80132b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:38.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b86905700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1b801330d0 0x7f1b800a85c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:38.812 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b86905700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b800a6d00 con 0x7f1b800a8b00 2023-09-30T01:58:38.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b86905700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1b800a77c0 con 0x7f1b801330d0 2023-09-30T01:58:38.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b86905700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b800a45d0 con 0x7f1b800a73f0 2023-09-30T01:58:38.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b85903700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1b800a73f0 0x7f1b80132b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:38.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b85903700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1b800a73f0 0x7f1b80132b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:38700/0 (socket says 172.21.15.55:38700) 2023-09-30T01:58:38.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b85903700 1 -- 172.21.15.55:0/729269506 learned_addr learned my addr 172.21.15.55:0/729269506 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:38.813 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b85102700 1 --2- 172.21.15.55:0/729269506 >> v2:172.21.15.55:3300/0 conn(0x7f1b801330d0 0x7f1b800a85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:38.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b85903700 1 -- 172.21.15.55:0/729269506 >> v2:172.21.15.55:3300/0 conn(0x7f1b801330d0 msgr2=0x7f1b800a85c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:38.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b85903700 1 --2- 172.21.15.55:0/729269506 >> v2:172.21.15.55:3300/0 conn(0x7f1b801330d0 0x7f1b800a85c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:38.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b85903700 1 -- 172.21.15.55:0/729269506 >> v1:172.21.15.55:6789/0 conn(0x7f1b800a8b00 legacy=0x7f1b800a6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:38.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b85903700 1 -- 172.21.15.55:0/729269506 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b800a8f80 con 0x7f1b800a73f0 2023-09-30T01:58:38.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.809+0000 7f1b85102700 1 --2- 172.21.15.55:0/729269506 >> v2:172.21.15.55:3300/0 conn(0x7f1b801330d0 0x7f1b800a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:58:38.815 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.813+0000 7f1b85903700 1 --2- 172.21.15.55:0/729269506 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1b800a73f0 0x7f1b80132b90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009990 tx=0x7f1b7c009220 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b8e9f4b22bdaddf7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:38.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.813+0000 7f1b84901700 1 -- 172.21.15.55:0/729269506 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c005c10 con 0x7f1b800a73f0 2023-09-30T01:58:38.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.813+0000 7f1b84901700 1 -- 172.21.15.55:0/729269506 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b7c005d70 con 0x7f1b800a73f0 2023-09-30T01:58:38.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.813+0000 7f1b84901700 1 -- 172.21.15.55:0/729269506 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b7c00b880 con 0x7f1b800a73f0 2023-09-30T01:58:38.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.813+0000 7f1b86905700 1 -- 172.21.15.55:0/729269506 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1b800a73f0 msgr2=0x7f1b80132b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:38.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.813+0000 7f1b86905700 1 --2- 172.21.15.55:0/729269506 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1b800a73f0 0x7f1b80132b90 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009990 tx=0x7f1b7c009220 comp rx=0 tx=0).stop 2023-09-30T01:58:38.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.813+0000 7f1b86905700 1 -- 172.21.15.55:0/729269506 shutdown_connections 2023-09-30T01:58:38.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.813+0000 7f1b86905700 1 --2- 172.21.15.55:0/729269506 >> v2:172.21.15.55:3300/0 conn(0x7f1b801330d0 0x7f1b800a85c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:38.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.813+0000 7f1b86905700 1 --2- 172.21.15.55:0/729269506 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1b800a73f0 0x7f1b80132b90 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:38.816 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.813+0000 7f1b86905700 1 -- 172.21.15.55:0/729269506 >> 172.21.15.55:0/729269506 conn(0x7f1b80062e20 msgr2=0x7f1b80063220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:38.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.813+0000 7f1b86905700 1 -- 172.21.15.55:0/729269506 shutdown_connections 2023-09-30T01:58:38.817 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.813+0000 7f1b86905700 1 -- 172.21.15.55:0/729269506 wait complete. 2023-09-30T01:58:38.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.813+0000 7f1b86905700 1 Processor -- start 2023-09-30T01:58:38.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.813+0000 7f1b86905700 1 -- start start 2023-09-30T01:58:38.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b86905700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b800a73f0 0x7f1b800b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:38.819 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b86905700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b800a8b00 0x7f1b8012f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b86905700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1b801330d0 0x7f1b8014dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b86905700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b800b01e0 con 0x7f1b800a8b00 2023-09-30T01:58:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b86905700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b800b03e0 con 0x7f1b800a73f0 2023-09-30T01:58:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b86905700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b8014e890 con 0x7f1b801330d0 2023-09-30T01:58:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b85102700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b800a8b00 0x7f1b8012f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b86104700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1b801330d0 0x7f1b8014dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b85102700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b800a8b00 0x7f1b8012f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:42476/0 (socket says 172.21.15.55:42476) 2023-09-30T01:58:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b85102700 1 -- 172.21.15.55:0/531920577 learned_addr learned my addr 172.21.15.55:0/531920577 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b85903700 1 --2- 172.21.15.55:0/531920577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b800a73f0 0x7f1b800b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b85102700 1 -- 172.21.15.55:0/531920577 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1b801330d0 msgr2=0x7f1b8014dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:38.820 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b85102700 1 --2- 172.21.15.55:0/531920577 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1b801330d0 0x7f1b8014dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b85102700 1 -- 172.21.15.55:0/531920577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b800a73f0 msgr2=0x7f1b800b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b85102700 1 --2- 172.21.15.55:0/531920577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b800a73f0 0x7f1b800b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b85102700 1 -- 172.21.15.55:0/531920577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b7c009480 con 0x7f1b800a8b00 2023-09-30T01:58:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b85903700 1 --2- 172.21.15.55:0/531920577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b800a73f0 0x7f1b800b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:58:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b85102700 1 --2- 172.21.15.55:0/531920577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b800a8b00 0x7f1b8012f100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000d860 tx=0x7f1b70008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b75ffb700 1 -- 172.21.15.55:0/531920577 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b700125f0 con 0x7f1b800a8b00 2023-09-30T01:58:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b75ffb700 1 -- 172.21.15.55:0/531920577 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b70012750 con 0x7f1b800a8b00 2023-09-30T01:58:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b86905700 1 -- 172.21.15.55:0/531920577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b8014eb50 con 0x7f1b800a8b00 2023-09-30T01:58:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b75ffb700 1 -- 172.21.15.55:0/531920577 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b70012af0 con 0x7f1b800a8b00 2023-09-30T01:58:38.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b86905700 1 -- 172.21.15.55:0/531920577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b800a62c0 con 0x7f1b800a8b00 2023-09-30T01:58:38.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.817+0000 7f1b86905700 1 -- 172.21.15.55:0/531920577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b800b0eb0 con 0x7f1b800a8b00 2023-09-30T01:58:38.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.821+0000 7f1b75ffb700 1 -- 172.21.15.55:0/531920577 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f1b70014430 con 0x7f1b800a8b00 2023-09-30T01:58:38.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.821+0000 7f1b75ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:38.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.821+0000 7f1b75ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:38.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.821+0000 7f1b75ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:38.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.821+0000 7f1b75ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:38.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.821+0000 7f1b75ffb700 1 --2- 172.21.15.55:0/531920577 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1b6408e930 0x7f1b64090de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:38.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.821+0000 7f1b85903700 1 --2- 172.21.15.55:0/531920577 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1b6408e930 0x7f1b64090de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:38.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.821+0000 7f1b75ffb700 1 -- 172.21.15.55:0/531920577 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f1b700b5540 con 0x7f1b800a8b00 2023-09-30T01:58:38.824 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.821+0000 7f1b85903700 1 --2- 172.21.15.55:0/531920577 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1b6408e930 0x7f1b64090de0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009260 tx=0x7f1b7c016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:38.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:38.825+0000 7f1b75ffb700 1 -- 172.21.15.55:0/531920577 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1b70085ed0 con 0x7f1b800a8b00 2023-09-30T01:58:39.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.017+0000 7f1b86905700 1 -- 172.21.15.55:0/531920577 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1b800b0eb0 con 0x7f1b800a8b00 2023-09-30T01:58:39.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.017+0000 7f1b75ffb700 1 -- 172.21.15.55:0/531920577 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f1b800b0eb0 con 0x7f1b800a8b00 2023-09-30T01:58:39.021 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:39.021 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:39.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.021+0000 7f1b86905700 10 mgrc shutdown 2023-09-30T01:58:39.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.021+0000 7f1b86905700 1 -- 172.21.15.55:0/531920577 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1b6408e930 msgr2=0x7f1b64090de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:39.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.021+0000 7f1b86905700 1 --2- 172.21.15.55:0/531920577 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1b6408e930 0x7f1b64090de0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1b7c009260 tx=0x7f1b7c016000 comp rx=0 tx=0).stop 2023-09-30T01:58:39.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.021+0000 7f1b86905700 1 -- 172.21.15.55:0/531920577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b800a8b00 msgr2=0x7f1b8012f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:39.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.021+0000 7f1b86905700 1 --2- 172.21.15.55:0/531920577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b800a8b00 0x7f1b8012f100 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1b7000d860 tx=0x7f1b70008040 comp rx=0 tx=0).stop 2023-09-30T01:58:39.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.021+0000 7f1b86905700 1 -- 172.21.15.55:0/531920577 shutdown_connections 2023-09-30T01:58:39.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.021+0000 7f1b86905700 1 --2- 172.21.15.55:0/531920577 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1b6408e930 0x7f1b64090de0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:39.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.021+0000 7f1b86905700 1 --2- 172.21.15.55:0/531920577 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1b801330d0 0x7f1b8014dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:39.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.021+0000 7f1b86905700 1 --2- 172.21.15.55:0/531920577 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1b800a8b00 0x7f1b8012f100 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:39.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.021+0000 7f1b86905700 1 --2- 172.21.15.55:0/531920577 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1b800a73f0 0x7f1b800b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:39.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.021+0000 7f1b86905700 1 -- 172.21.15.55:0/531920577 >> 172.21.15.55:0/531920577 conn(0x7f1b80062e20 msgr2=0x7f1b800a4710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:39.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.021+0000 7f1b86905700 1 -- 172.21.15.55:0/531920577 shutdown_connections 2023-09-30T01:58:39.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:39.021+0000 7f1b86905700 1 -- 172.21.15.55:0/531920577 wait complete. 2023-09-30T01:58:42.039 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:42.156 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8ad2b7700 1 Processor -- start 2023-09-30T01:58:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8ad2b7700 1 -- start start 2023-09-30T01:58:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8ad2b7700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a80b3060 0x7fd8a80a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8ad2b7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fd8a813e5f0 0x7fd8a813e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8ad2b7700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a80b3430 con 0x7fd8a80a7810 2023-09-30T01:58:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8ad2b7700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a813b8f0 con 0x7fd8a813e5f0 2023-09-30T01:58:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8ad2b7700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a80a4b60 con 0x7fd8a80b3060 2023-09-30T01:58:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8a6ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a80b3060 0x7fd8a80a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8a6ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a80b3060 0x7fd8a80a6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:40582/0 (socket says 172.21.15.55:40582) 2023-09-30T01:58:42.157 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8a6ffd700 1 -- 172.21.15.55:0/3637517948 learned_addr learned my addr 172.21.15.55:0/3637517948 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8a67fc700 1 --2- 172.21.15.55:0/3637517948 >> v2:172.21.15.55:3300/0 conn(0x7fd8a813e5f0 0x7fd8a813e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8a6ffd700 1 -- 172.21.15.55:0/3637517948 >> v2:172.21.15.55:3300/0 conn(0x7fd8a813e5f0 msgr2=0x7fd8a813e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8a6ffd700 1 --2- 172.21.15.55:0/3637517948 >> v2:172.21.15.55:3300/0 conn(0x7fd8a813e5f0 0x7fd8a813e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8a6ffd700 1 -- 172.21.15.55:0/3637517948 >> v1:172.21.15.55:6789/0 conn(0x7fd8a80a7810 legacy=0x7fd8a80a7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8a6ffd700 1 -- 172.21.15.55:0/3637517948 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a813dfa0 con 0x7fd8a80b3060 2023-09-30T01:58:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8a67fc700 1 --2- 172.21.15.55:0/3637517948 >> v2:172.21.15.55:3300/0 conn(0x7fd8a813e5f0 0x7fd8a813e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:58:42.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8a6ffd700 1 --2- 172.21.15.55:0/3637517948 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a80b3060 0x7fd8a80a6120 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009f20 tx=0x7fd8a0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0efc6d1d810b7fb server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:42.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.153+0000 7fd8a5ffb700 1 -- 172.21.15.55:0/3637517948 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a000e070 con 0x7fd8a80b3060 2023-09-30T01:58:42.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.157+0000 7fd8a5ffb700 1 -- 172.21.15.55:0/3637517948 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a000ba80 con 0x7fd8a80b3060 2023-09-30T01:58:42.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.157+0000 7fd8a5ffb700 1 -- 172.21.15.55:0/3637517948 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00092e0 con 0x7fd8a80b3060 2023-09-30T01:58:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.157+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/3637517948 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a80b3060 msgr2=0x7fd8a80a6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.157+0000 7fd8ad2b7700 1 --2- 172.21.15.55:0/3637517948 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a80b3060 0x7fd8a80a6120 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0009f20 tx=0x7fd8a0009840 comp rx=0 tx=0).stop 2023-09-30T01:58:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.157+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/3637517948 shutdown_connections 2023-09-30T01:58:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.157+0000 7fd8ad2b7700 1 --2- 172.21.15.55:0/3637517948 >> v2:172.21.15.55:3300/0 conn(0x7fd8a813e5f0 0x7fd8a813e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.157+0000 7fd8ad2b7700 1 --2- 172.21.15.55:0/3637517948 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a80b3060 0x7fd8a80a6120 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.157+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/3637517948 >> 172.21.15.55:0/3637517948 conn(0x7fd8a8068b00 msgr2=0x7fd8a80b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.157+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/3637517948 shutdown_connections 2023-09-30T01:58:42.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.157+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/3637517948 wait complete. 2023-09-30T01:58:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.157+0000 7fd8ad2b7700 1 Processor -- start 2023-09-30T01:58:42.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.157+0000 7fd8ad2b7700 1 -- start start 2023-09-30T01:58:42.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8ad2b7700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a80a7810 0x7fd8a8142610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8ad2b7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a80b3060 0x7fd8a80adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8ad2b7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a813e5f0 0x7fd8a80ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8ad2b7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a80ae710 con 0x7fd8a80b3060 2023-09-30T01:58:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8ad2b7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8143e80 con 0x7fd8a813e5f0 2023-09-30T01:58:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8ad2b7700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8142fe0 con 0x7fd8a80a7810 2023-09-30T01:58:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8a6ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a80a7810 0x7fd8a8142610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8a6ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a80a7810 0x7fd8a8142610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:40596/0 (socket says 172.21.15.55:40596) 2023-09-30T01:58:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8a67fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a80b3060 0x7fd8a80adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8a6ffd700 1 -- 172.21.15.55:0/2145488570 learned_addr learned my addr 172.21.15.55:0/2145488570 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:42.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8a77fe700 1 --2- 172.21.15.55:0/2145488570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a813e5f0 0x7fd8a80ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8a6ffd700 1 -- 172.21.15.55:0/2145488570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a813e5f0 msgr2=0x7fd8a80ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8a6ffd700 1 --2- 172.21.15.55:0/2145488570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a813e5f0 0x7fd8a80ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8a6ffd700 1 -- 172.21.15.55:0/2145488570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a80b3060 msgr2=0x7fd8a80adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8a6ffd700 1 --2- 172.21.15.55:0/2145488570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a80b3060 0x7fd8a80adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8a6ffd700 1 -- 172.21.15.55:0/2145488570 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a0009ae0 con 0x7fd8a80a7810 2023-09-30T01:58:42.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8a6ffd700 1 --2- 172.21.15.55:0/2145488570 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a80a7810 0x7fd8a8142610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0003440 tx=0x7fd8a0018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:42.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd89effd700 1 -- 172.21.15.55:0/2145488570 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0008980 con 0x7fd8a80a7810 2023-09-30T01:58:42.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd89effd700 1 -- 172.21.15.55:0/2145488570 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a0008ae0 con 0x7fd8a80a7810 2023-09-30T01:58:42.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd89effd700 1 -- 172.21.15.55:0/2145488570 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0008ea0 con 0x7fd8a80a7810 2023-09-30T01:58:42.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/2145488570 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a81432a0 con 0x7fd8a80a7810 2023-09-30T01:58:42.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.161+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/2145488570 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a80aa6d0 con 0x7fd8a80a7810 2023-09-30T01:58:42.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.165+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/2145488570 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a8068300 con 0x7fd8a80a7810 2023-09-30T01:58:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.165+0000 7fd89effd700 1 -- 172.21.15.55:0/2145488570 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fd8a0003040 con 0x7fd8a80a7810 2023-09-30T01:58:42.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.165+0000 7fd89effd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:42.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.165+0000 7fd89effd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:42.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.165+0000 7fd89effd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:42.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.165+0000 7fd89effd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:42.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.165+0000 7fd89effd700 1 --2- 172.21.15.55:0/2145488570 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd88808e8b0 0x7fd888090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:42.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.165+0000 7fd89effd700 1 -- 172.21.15.55:0/2145488570 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fd8a00b66d0 con 0x7fd8a80a7810 2023-09-30T01:58:42.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.165+0000 7fd8a67fc700 1 --2- 172.21.15.55:0/2145488570 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd88808e8b0 0x7fd888090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:42.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.169+0000 7fd8a67fc700 1 --2- 172.21.15.55:0/2145488570 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd88808e8b0 0x7fd888090d60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8142400 tx=0x7fd890008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:42.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.169+0000 7fd89effd700 1 -- 172.21.15.55:0/2145488570 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fd8a0087060 con 0x7fd8a80a7810 2023-09-30T01:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.361+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/2145488570 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fd8a804b5c0 con 0x7fd8a80a7810 2023-09-30T01:58:42.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.361+0000 7fd89effd700 1 -- 172.21.15.55:0/2145488570 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fd8a008a680 con 0x7fd8a80a7810 2023-09-30T01:58:42.364 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:42.364 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.365+0000 7fd8ad2b7700 10 mgrc shutdown 2023-09-30T01:58:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.365+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/2145488570 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd88808e8b0 msgr2=0x7fd888090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.365+0000 7fd8ad2b7700 1 --2- 172.21.15.55:0/2145488570 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd88808e8b0 0x7fd888090d60 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd8a8142400 tx=0x7fd890008040 comp rx=0 tx=0).stop 2023-09-30T01:58:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.365+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/2145488570 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a80a7810 msgr2=0x7fd8a8142610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.365+0000 7fd8ad2b7700 1 --2- 172.21.15.55:0/2145488570 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a80a7810 0x7fd8a8142610 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0003440 tx=0x7fd8a0018000 comp rx=0 tx=0).stop 2023-09-30T01:58:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.365+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/2145488570 shutdown_connections 2023-09-30T01:58:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.365+0000 7fd8ad2b7700 1 --2- 172.21.15.55:0/2145488570 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fd8a813e5f0 0x7fd8a80ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:42.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.365+0000 7fd8ad2b7700 1 --2- 172.21.15.55:0/2145488570 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fd8a80b3060 0x7fd8a80adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:42.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.365+0000 7fd8ad2b7700 1 --2- 172.21.15.55:0/2145488570 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fd88808e8b0 0x7fd888090d60 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:42.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.365+0000 7fd8ad2b7700 1 --2- 172.21.15.55:0/2145488570 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fd8a80a7810 0x7fd8a8142610 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:42.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.365+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/2145488570 >> 172.21.15.55:0/2145488570 conn(0x7fd8a8068b00 msgr2=0x7fd8a813a060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:42.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.365+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/2145488570 shutdown_connections 2023-09-30T01:58:42.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:42.365+0000 7fd8ad2b7700 1 -- 172.21.15.55:0/2145488570 wait complete. 2023-09-30T01:58:44.053 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:58:44.055 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:58:45.379 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:45.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc3fff700 1 Processor -- start 2023-09-30T01:58:45.494 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc3fff700 1 -- start start 2023-09-30T01:58:45.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc3fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcdc40a65f0 0x7fcdc413f840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:45.495 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc3fff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc4067b90 con 0x7fcdc413fd80 2023-09-30T01:58:45.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc3fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcdc40a5460 con 0x7fcdc40677c0 2023-09-30T01:58:45.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc3fff700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcdc40a9ae0 con 0x7fcdc40a65f0 2023-09-30T01:58:45.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc37fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fcdc413fd80 0x7fcdc414a9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43608/0 (socket says 172.21.15.55:43608) 2023-09-30T01:58:45.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc27fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fcdc40a65f0 0x7fcdc413f840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:45.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc37fe700 1 -- 172.21.15.55:0/2603964 learned_addr learned my addr 172.21.15.55:0/2603964 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:58:45.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc1ffb700 1 -- 172.21.15.55:0/2603964 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731207962 0 0) 0x7fcdc4067b90 con 0x7fcdc413fd80 2023-09-30T01:58:45.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc1ffb700 1 -- 172.21.15.55:0/2603964 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdac003570 con 0x7fcdc413fd80 2023-09-30T01:58:45.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc27fc700 1 -- 172.21.15.55:0/2603964 >> v1:172.21.15.133:6789/0 conn(0x7fcdc40677c0 legacy=0x7fcdc40a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:45.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc27fc700 1 -- 172.21.15.55:0/2603964 >> v1:172.21.15.55:6789/0 conn(0x7fcdc413fd80 legacy=0x7fcdc414a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:45.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc27fc700 1 -- 172.21.15.55:0/2603964 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdc40a5720 con 0x7fcdc40a65f0 2023-09-30T01:58:45.497 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc27fc700 1 --2- 172.21.15.55:0/2603964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdc40a65f0 0x7fcdc413f840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcdb80098e0 tx=0x7fcdb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfce168fe73484e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:45.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc1ffb700 1 -- 172.21.15.55:0/2603964 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb800b640 con 0x7fcdc40a65f0 2023-09-30T01:58:45.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc1ffb700 1 -- 172.21.15.55:0/2603964 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb800b7a0 con 0x7fcdc40a65f0 2023-09-30T01:58:45.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc1ffb700 1 -- 172.21.15.55:0/2603964 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb800bb40 con 0x7fcdc40a65f0 2023-09-30T01:58:45.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc3fff700 1 -- 172.21.15.55:0/2603964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdc40a65f0 msgr2=0x7fcdc413f840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:45.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.493+0000 7fcdc3fff700 1 --2- 172.21.15.55:0/2603964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdc40a65f0 0x7fcdc413f840 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fcdb80098e0 tx=0x7fcdb80091a0 comp rx=0 tx=0).stop 2023-09-30T01:58:45.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 -- 172.21.15.55:0/2603964 shutdown_connections 2023-09-30T01:58:45.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 --2- 172.21.15.55:0/2603964 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdc40a65f0 0x7fcdc413f840 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:45.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 -- 172.21.15.55:0/2603964 >> 172.21.15.55:0/2603964 conn(0x7fcdc4068820 msgr2=0x7fcdc4068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:45.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 -- 172.21.15.55:0/2603964 shutdown_connections 2023-09-30T01:58:45.498 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 -- 172.21.15.55:0/2603964 wait complete. 2023-09-30T01:58:45.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 Processor -- start 2023-09-30T01:58:45.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 -- start start 2023-09-30T01:58:45.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdc40677c0 0x7fcdc409a090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:45.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdc40a65f0 0x7fcdc4143230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:45.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdc413fd80 0x7fcdc406cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:45.500 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc406e220 con 0x7fcdc40677c0 2023-09-30T01:58:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc4150360 con 0x7fcdc413fd80 2023-09-30T01:58:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdc4150620 con 0x7fcdc40a65f0 2023-09-30T01:58:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc27fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdc40a65f0 0x7fcdc4143230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdc40677c0 0x7fcdc409a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc2ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdc40677c0 0x7fcdc409a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45866/0 (socket says 172.21.15.55:45866) 2023-09-30T01:58:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc27fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdc40a65f0 0x7fcdc4143230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:40600/0 (socket says 172.21.15.55:40600) 2023-09-30T01:58:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc2ffd700 1 -- 172.21.15.55:0/1124363027 learned_addr learned my addr 172.21.15.55:0/1124363027 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:45.501 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc37fe700 1 --2- 172.21.15.55:0/1124363027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdc413fd80 0x7fcdc406cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:45.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc27fc700 1 -- 172.21.15.55:0/1124363027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdc413fd80 msgr2=0x7fcdc406cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:45.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc27fc700 1 --2- 172.21.15.55:0/1124363027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdc413fd80 0x7fcdc406cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:45.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc27fc700 1 -- 172.21.15.55:0/1124363027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdc40677c0 msgr2=0x7fcdc409a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:45.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc27fc700 1 --2- 172.21.15.55:0/1124363027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdc40677c0 0x7fcdc409a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:45.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc27fc700 1 -- 172.21.15.55:0/1124363027 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdb8009420 con 0x7fcdc40a65f0 2023-09-30T01:58:45.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc2ffd700 1 --2- 172.21.15.55:0/1124363027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdc40677c0 0x7fcdc409a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:58:45.502 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc27fc700 1 --2- 172.21.15.55:0/1124363027 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdc40a65f0 0x7fcdc4143230 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8016000 tx=0x7fcdb8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:45.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdaaffd700 1 -- 172.21.15.55:0/1124363027 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8000d10 con 0x7fcdc40a65f0 2023-09-30T01:58:45.503 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdaaffd700 1 -- 172.21.15.55:0/1124363027 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdb800bb20 con 0x7fcdc40a65f0 2023-09-30T01:58:45.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1124363027 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdc4143770 con 0x7fcdc40a65f0 2023-09-30T01:58:45.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdaaffd700 1 -- 172.21.15.55:0/1124363027 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdb8011650 con 0x7fcdc40a65f0 2023-09-30T01:58:45.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.497+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1124363027 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdc4150fe0 con 0x7fcdc40a65f0 2023-09-30T01:58:45.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.501+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1124363027 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdc406da70 con 0x7fcdc40a65f0 2023-09-30T01:58:45.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.501+0000 7fcdaaffd700 1 -- 172.21.15.55:0/1124363027 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fcdb80119c0 con 0x7fcdc40a65f0 2023-09-30T01:58:45.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.501+0000 7fcdaaffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:45.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.505+0000 7fcdaaffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:45.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.505+0000 7fcdaaffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:45.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.505+0000 7fcdaaffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:45.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.505+0000 7fcdaaffd700 1 --2- 172.21.15.55:0/1124363027 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcdb008e8e0 0x7fcdb0090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:45.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.505+0000 7fcdc2ffd700 1 --2- 172.21.15.55:0/1124363027 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcdb008e8e0 0x7fcdb0090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:45.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.505+0000 7fcdaaffd700 1 -- 172.21.15.55:0/1124363027 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fcdb80b5f70 con 0x7fcdc40a65f0 2023-09-30T01:58:45.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.505+0000 7fcdc2ffd700 1 --2- 172.21.15.55:0/1124363027 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcdb008e8e0 0x7fcdb0090d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc007fd0 tx=0x7fcdbc009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:45.511 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.509+0000 7fcdaaffd700 1 -- 172.21.15.55:0/1124363027 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fcdb80869a0 con 0x7fcdc40a65f0 2023-09-30T01:58:45.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.705+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1124363027 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fcdc406da70 con 0x7fcdc40a65f0 2023-09-30T01:58:45.706 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.705+0000 7fcdaaffd700 1 -- 172.21.15.55:0/1124363027 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fcdc406da70 con 0x7fcdc40a65f0 2023-09-30T01:58:45.707 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:45.707 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:45.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.705+0000 7fcdc3fff700 10 mgrc shutdown 2023-09-30T01:58:45.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.705+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1124363027 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcdb008e8e0 msgr2=0x7fcdb0090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:45.709 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.705+0000 7fcdc3fff700 1 --2- 172.21.15.55:0/1124363027 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcdb008e8e0 0x7fcdb0090d90 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fcdbc007fd0 tx=0x7fcdbc009040 comp rx=0 tx=0).stop 2023-09-30T01:58:45.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.705+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1124363027 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdc40a65f0 msgr2=0x7fcdc4143230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:45.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.705+0000 7fcdc3fff700 1 --2- 172.21.15.55:0/1124363027 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdc40a65f0 0x7fcdc4143230 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fcdb8016000 tx=0x7fcdb8017000 comp rx=0 tx=0).stop 2023-09-30T01:58:45.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.705+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1124363027 shutdown_connections 2023-09-30T01:58:45.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.705+0000 7fcdc3fff700 1 --2- 172.21.15.55:0/1124363027 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fcdc413fd80 0x7fcdc406cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:45.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.705+0000 7fcdc3fff700 1 --2- 172.21.15.55:0/1124363027 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fcdb008e8e0 0x7fcdb0090d90 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:45.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.705+0000 7fcdc3fff700 1 --2- 172.21.15.55:0/1124363027 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fcdc40a65f0 0x7fcdc4143230 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:45.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.705+0000 7fcdc3fff700 1 --2- 172.21.15.55:0/1124363027 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fcdc40677c0 0x7fcdc409a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:45.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.705+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1124363027 >> 172.21.15.55:0/1124363027 conn(0x7fcdc4068820 msgr2=0x7fcdc4068bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:45.710 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.709+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1124363027 shutdown_connections 2023-09-30T01:58:45.711 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:45.709+0000 7fcdc3fff700 1 -- 172.21.15.55:0/1124363027 wait complete. 2023-09-30T01:58:48.722 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:48.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb30eaff700 1 Processor -- start 2023-09-30T01:58:48.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb30eaff700 1 -- start start 2023-09-30T01:58:48.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb30eaff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb3080aba40 0x7fb3080abe50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:48.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb30eaff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3080ac430 con 0x7fb308140960 2023-09-30T01:58:48.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb30eaff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb308140020 con 0x7fb308067c80 2023-09-30T01:58:48.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb30eaff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3081402e0 con 0x7fb3080aba40 2023-09-30T01:58:48.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb30c89b700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb308140960 0x7fb3080a9880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:43612/0 (socket says 172.21.15.55:43612) 2023-09-30T01:58:48.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb30c89b700 1 -- 172.21.15.55:0/2692549257 learned_addr learned my addr 172.21.15.55:0/2692549257 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:58:48.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb30d09c700 1 --2- 172.21.15.55:0/2692549257 >> v2:172.21.15.133:3300/0 conn(0x7fb3080aba40 0x7fb3080abe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:48.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb3077fe700 1 -- 172.21.15.55:0/2692549257 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1062236553 0 0) 0x7fb3080ac430 con 0x7fb308140960 2023-09-30T01:58:48.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb3077fe700 1 -- 172.21.15.55:0/2692549257 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb2f0003570 con 0x7fb308140960 2023-09-30T01:58:48.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb30d09c700 1 -- 172.21.15.55:0/2692549257 >> v1:172.21.15.133:6789/0 conn(0x7fb308067c80 legacy=0x7fb3080aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:48.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb30d09c700 1 -- 172.21.15.55:0/2692549257 >> v1:172.21.15.55:6789/0 conn(0x7fb308140960 legacy=0x7fb3080a9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:48.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb30d09c700 1 -- 172.21.15.55:0/2692549257 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb308140d30 con 0x7fb3080aba40 2023-09-30T01:58:48.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb30d09c700 1 --2- 172.21.15.55:0/2692549257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3080aba40 0x7fb3080abe50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb3000098e0 tx=0x7fb3000091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eddbfb6a5341f268 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:48.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb3077fe700 1 -- 172.21.15.55:0/2692549257 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30000b6d0 con 0x7fb3080aba40 2023-09-30T01:58:48.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb3077fe700 1 -- 172.21.15.55:0/2692549257 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb30000b830 con 0x7fb3080aba40 2023-09-30T01:58:48.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.832+0000 7fb3077fe700 1 -- 172.21.15.55:0/2692549257 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb30000bbd0 con 0x7fb3080aba40 2023-09-30T01:58:48.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 -- 172.21.15.55:0/2692549257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3080aba40 msgr2=0x7fb3080abe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:48.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 --2- 172.21.15.55:0/2692549257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3080aba40 0x7fb3080abe50 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb3000098e0 tx=0x7fb3000091a0 comp rx=0 tx=0).stop 2023-09-30T01:58:48.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 -- 172.21.15.55:0/2692549257 shutdown_connections 2023-09-30T01:58:48.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 --2- 172.21.15.55:0/2692549257 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb3080aba40 0x7fb3080abe50 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:48.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 -- 172.21.15.55:0/2692549257 >> 172.21.15.55:0/2692549257 conn(0x7fb3080698e0 msgr2=0x7fb3080670a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:48.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 -- 172.21.15.55:0/2692549257 shutdown_connections 2023-09-30T01:58:48.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 -- 172.21.15.55:0/2692549257 wait complete. 2023-09-30T01:58:48.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 Processor -- start 2023-09-30T01:58:48.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 -- start start 2023-09-30T01:58:48.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb308067c80 0x7fb3081447c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:48.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3080aba40 0x7fb308145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:48.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb308140960 0x7fb308145f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:48.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb308144d00 con 0x7fb3080aba40 2023-09-30T01:58:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb308145220 con 0x7fb308140960 2023-09-30T01:58:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30eaff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3081384e0 con 0x7fb308067c80 2023-09-30T01:58:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30c89b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb308067c80 0x7fb3081447c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb307fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3080aba40 0x7fb308145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb307fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3080aba40 0x7fb308145a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45868/0 (socket says 172.21.15.55:45868) 2023-09-30T01:58:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30c89b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb308067c80 0x7fb3081447c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:40614/0 (socket says 172.21.15.55:40614) 2023-09-30T01:58:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb307fff700 1 -- 172.21.15.55:0/607754667 learned_addr learned my addr 172.21.15.55:0/607754667 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30d09c700 1 --2- 172.21.15.55:0/607754667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb308140960 0x7fb308145f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30c89b700 1 -- 172.21.15.55:0/607754667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb308140960 msgr2=0x7fb308145f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:48.842 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30c89b700 1 --2- 172.21.15.55:0/607754667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb308140960 0x7fb308145f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30c89b700 1 -- 172.21.15.55:0/607754667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3080aba40 msgr2=0x7fb308145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30c89b700 1 --2- 172.21.15.55:0/607754667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3080aba40 0x7fb308145a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30c89b700 1 -- 172.21.15.55:0/607754667 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb300009420 con 0x7fb308067c80 2023-09-30T01:58:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb307fff700 1 --2- 172.21.15.55:0/607754667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3080aba40 0x7fb308145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:58:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.836+0000 7fb30c89b700 1 --2- 172.21.15.55:0/607754667 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb308067c80 0x7fb3081447c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00c580 tx=0x7fb2fc007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.840+0000 7fb304ff9700 1 -- 172.21.15.55:0/607754667 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc005b30 con 0x7fb308067c80 2023-09-30T01:58:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.840+0000 7fb304ff9700 1 -- 172.21.15.55:0/607754667 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2fc005cb0 con 0x7fb308067c80 2023-09-30T01:58:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.840+0000 7fb30eaff700 1 -- 172.21.15.55:0/607754667 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3081387a0 con 0x7fb308067c80 2023-09-30T01:58:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.840+0000 7fb304ff9700 1 -- 172.21.15.55:0/607754667 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2fc007320 con 0x7fb308067c80 2023-09-30T01:58:48.843 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.840+0000 7fb30eaff700 1 -- 172.21.15.55:0/607754667 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb308133170 con 0x7fb308067c80 2023-09-30T01:58:48.844 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.840+0000 7fb30eaff700 1 -- 172.21.15.55:0/607754667 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb308146480 con 0x7fb308067c80 2023-09-30T01:58:48.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.844+0000 7fb304ff9700 1 -- 172.21.15.55:0/607754667 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fb2fc01b3b0 con 0x7fb308067c80 2023-09-30T01:58:48.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.844+0000 7fb304ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.844+0000 7fb304ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.844+0000 7fb304ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.844+0000 7fb304ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.844+0000 7fb304ff9700 1 --2- 172.21.15.55:0/607754667 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb2f408e830 0x7fb2f4090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.844+0000 7fb307fff700 1 --2- 172.21.15.55:0/607754667 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb2f408e830 0x7fb2f4090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.844+0000 7fb304ff9700 1 -- 172.21.15.55:0/607754667 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fb2fc0b4190 con 0x7fb308067c80 2023-09-30T01:58:48.847 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.844+0000 7fb307fff700 1 --2- 172.21.15.55:0/607754667 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb2f408e830 0x7fb2f4090ce0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb308141490 tx=0x7fb2f8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:48.849 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:48.848+0000 7fb304ff9700 1 -- 172.21.15.55:0/607754667 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb2fc084b30 con 0x7fb308067c80 2023-09-30T01:58:49.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.040+0000 7fb30eaff700 1 -- 172.21.15.55:0/607754667 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb308133360 con 0x7fb308067c80 2023-09-30T01:58:49.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.040+0000 7fb304ff9700 1 -- 172.21.15.55:0/607754667 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fb2fc017080 con 0x7fb308067c80 2023-09-30T01:58:49.044 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:49.044 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:49.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.044+0000 7fb30eaff700 10 mgrc shutdown 2023-09-30T01:58:49.046 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.044+0000 7fb30eaff700 1 -- 172.21.15.55:0/607754667 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb2f408e830 msgr2=0x7fb2f4090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:49.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.044+0000 7fb30eaff700 1 --2- 172.21.15.55:0/607754667 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb2f408e830 0x7fb2f4090ce0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fb308141490 tx=0x7fb2f8009040 comp rx=0 tx=0).stop 2023-09-30T01:58:49.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.044+0000 7fb30eaff700 1 -- 172.21.15.55:0/607754667 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb308067c80 msgr2=0x7fb3081447c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:49.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.044+0000 7fb30eaff700 1 --2- 172.21.15.55:0/607754667 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb308067c80 0x7fb3081447c0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc00c580 tx=0x7fb2fc007d50 comp rx=0 tx=0).stop 2023-09-30T01:58:49.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.044+0000 7fb30eaff700 1 -- 172.21.15.55:0/607754667 shutdown_connections 2023-09-30T01:58:49.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.044+0000 7fb30eaff700 1 --2- 172.21.15.55:0/607754667 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb308140960 0x7fb308145f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:49.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.044+0000 7fb30eaff700 1 --2- 172.21.15.55:0/607754667 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb3080aba40 0x7fb308145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:49.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.044+0000 7fb30eaff700 1 --2- 172.21.15.55:0/607754667 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb2f408e830 0x7fb2f4090ce0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:49.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.044+0000 7fb30eaff700 1 --2- 172.21.15.55:0/607754667 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb308067c80 0x7fb3081447c0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:49.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.044+0000 7fb30eaff700 1 -- 172.21.15.55:0/607754667 >> 172.21.15.55:0/607754667 conn(0x7fb3080698e0 msgr2=0x7fb30806c480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:49.047 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.044+0000 7fb30eaff700 1 -- 172.21.15.55:0/607754667 shutdown_connections 2023-09-30T01:58:49.048 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:49.044+0000 7fb30eaff700 1 -- 172.21.15.55:0/607754667 wait complete. 2023-09-30T01:58:52.060 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:52.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.168+0000 7ff8d19e3700 1 Processor -- start 2023-09-30T01:58:52.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.168+0000 7ff8d19e3700 1 -- start start 2023-09-30T01:58:52.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d19e3700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8cc0a0d80 0x7ff8cc0a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:52.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d19e3700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8cc13e6f0 0x7ff8cc0a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:52.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d19e3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8cc09f480 con 0x7ff8cc0a1150 2023-09-30T01:58:52.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d19e3700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8cc09f740 con 0x7ff8cc13e6f0 2023-09-30T01:58:52.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d19e3700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc06e040 con 0x7ff8cc0a0d80 2023-09-30T01:58:52.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d11e2700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8cc13e6f0 0x7ff8cc0a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:52.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d11e2700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7ff8cc13e6f0 0x7ff8cc0a4fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46444/0 (socket says 172.21.15.55:46444) 2023-09-30T01:58:52.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d11e2700 1 -- 172.21.15.55:0/2858087405 learned_addr learned my addr 172.21.15.55:0/2858087405 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:52.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d09e1700 1 --2- 172.21.15.55:0/2858087405 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8cc0a0d80 0x7ff8cc0a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:52.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d11e2700 1 -- 172.21.15.55:0/2858087405 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8cc0a0d80 msgr2=0x7ff8cc0a4a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:52.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d11e2700 1 --2- 172.21.15.55:0/2858087405 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8cc0a0d80 0x7ff8cc0a4a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:52.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d11e2700 1 -- 172.21.15.55:0/2858087405 >> v1:172.21.15.133:6789/0 conn(0x7ff8cc0a1150 legacy=0x7ff8cc13dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:52.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d11e2700 1 -- 172.21.15.55:0/2858087405 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8cc0a2240 con 0x7ff8cc13e6f0 2023-09-30T01:58:52.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d11e2700 1 --2- 172.21.15.55:0/2858087405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc13e6f0 0x7ff8cc0a4fd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40099b0 tx=0x7ff8c4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d65167359b75058 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:52.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8cb7fe700 1 -- 172.21.15.55:0/2858087405 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c4009ea0 con 0x7ff8cc13e6f0 2023-09-30T01:58:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8cb7fe700 1 -- 172.21.15.55:0/2858087405 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8c400b860 con 0x7ff8cc13e6f0 2023-09-30T01:58:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8cb7fe700 1 -- 172.21.15.55:0/2858087405 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400bc00 con 0x7ff8cc13e6f0 2023-09-30T01:58:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d19e3700 1 -- 172.21.15.55:0/2858087405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc13e6f0 msgr2=0x7ff8cc0a4fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d19e3700 1 --2- 172.21.15.55:0/2858087405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc13e6f0 0x7ff8cc0a4fd0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7ff8c40099b0 tx=0x7ff8c4009250 comp rx=0 tx=0).stop 2023-09-30T01:58:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d19e3700 1 -- 172.21.15.55:0/2858087405 shutdown_connections 2023-09-30T01:58:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d19e3700 1 --2- 172.21.15.55:0/2858087405 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc13e6f0 0x7ff8cc0a4fd0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d19e3700 1 --2- 172.21.15.55:0/2858087405 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8cc0a0d80 0x7ff8cc0a4a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d19e3700 1 -- 172.21.15.55:0/2858087405 >> 172.21.15.55:0/2858087405 conn(0x7ff8cc0b23d0 msgr2=0x7ff8cc0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d19e3700 1 -- 172.21.15.55:0/2858087405 shutdown_connections 2023-09-30T01:58:52.177 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.172+0000 7ff8d19e3700 1 -- 172.21.15.55:0/2858087405 wait complete. 2023-09-30T01:58:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8d19e3700 1 Processor -- start 2023-09-30T01:58:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8d19e3700 1 -- start start 2023-09-30T01:58:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8d19e3700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8cc0a0d80 0x7ff8cc140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8d19e3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc0a1150 0x7ff8cc09b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8d19e3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8cc13e6f0 0x7ff8cc13ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8d19e3700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc06c1b0 con 0x7ff8cc0a1150 2023-09-30T01:58:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8d19e3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc153490 con 0x7ff8cc13e6f0 2023-09-30T01:58:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8d19e3700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8cc153750 con 0x7ff8cc0a0d80 2023-09-30T01:58:52.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8cbfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc0a1150 0x7ff8cc09b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8d09e1700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8cc0a0d80 0x7ff8cc140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8cbfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc0a1150 0x7ff8cc09b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46448/0 (socket says 172.21.15.55:46448) 2023-09-30T01:58:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8cbfff700 1 -- 172.21.15.55:0/488239353 learned_addr learned my addr 172.21.15.55:0/488239353 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8d11e2700 1 --2- 172.21.15.55:0/488239353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8cc13e6f0 0x7ff8cc13ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8cbfff700 1 -- 172.21.15.55:0/488239353 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8cc0a0d80 msgr2=0x7ff8cc140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8cbfff700 1 --2- 172.21.15.55:0/488239353 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8cc0a0d80 0x7ff8cc140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8cbfff700 1 -- 172.21.15.55:0/488239353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8cc13e6f0 msgr2=0x7ff8cc13ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8cbfff700 1 --2- 172.21.15.55:0/488239353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8cc13e6f0 0x7ff8cc13ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8cbfff700 1 -- 172.21.15.55:0/488239353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8c40094f0 con 0x7ff8cc0a1150 2023-09-30T01:58:52.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8d09e1700 1 --2- 172.21.15.55:0/488239353 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8cc0a0d80 0x7ff8cc140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:58:52.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8cbfff700 1 --2- 172.21.15.55:0/488239353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc0a1150 0x7ff8cc09b660 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00cb10 tx=0x7ff8bc0017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:52.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8c8ff9700 1 -- 172.21.15.55:0/488239353 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00ce20 con 0x7ff8cc0a1150 2023-09-30T01:58:52.181 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8c8ff9700 1 -- 172.21.15.55:0/488239353 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8bc00a7e0 con 0x7ff8cc0a1150 2023-09-30T01:58:52.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8d19e3700 1 -- 172.21.15.55:0/488239353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8cc09aac0 con 0x7ff8cc0a1150 2023-09-30T01:58:52.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8c8ff9700 1 -- 172.21.15.55:0/488239353 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8bc00aba0 con 0x7ff8cc0a1150 2023-09-30T01:58:52.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.176+0000 7ff8d19e3700 1 -- 172.21.15.55:0/488239353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8cc06bb10 con 0x7ff8cc0a1150 2023-09-30T01:58:52.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.180+0000 7ff8d19e3700 1 -- 172.21.15.55:0/488239353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8cc064440 con 0x7ff8cc0a1150 2023-09-30T01:58:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.180+0000 7ff8c8ff9700 1 -- 172.21.15.55:0/488239353 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7ff8bc003030 con 0x7ff8cc0a1150 2023-09-30T01:58:52.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.180+0000 7ff8c8ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:52.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.180+0000 7ff8c8ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:52.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.180+0000 7ff8c8ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:52.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.180+0000 7ff8c8ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:52.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.184+0000 7ff8c8ff9700 1 --2- 172.21.15.55:0/488239353 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff8b808e8b0 0x7ff8b8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:52.185 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.184+0000 7ff8d09e1700 1 --2- 172.21.15.55:0/488239353 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff8b808e8b0 0x7ff8b8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:52.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.184+0000 7ff8c8ff9700 1 -- 172.21.15.55:0/488239353 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7ff8bc0b4920 con 0x7ff8cc0a1150 2023-09-30T01:58:52.186 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.184+0000 7ff8d09e1700 1 --2- 172.21.15.55:0/488239353 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff8b808e8b0 0x7ff8b8090d60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0011480 tx=0x7ff8c00091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:52.193 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.188+0000 7ff8c8ff9700 1 -- 172.21.15.55:0/488239353 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7ff8bc085220 con 0x7ff8cc0a1150 2023-09-30T01:58:52.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.388+0000 7ff8d19e3700 1 -- 172.21.15.55:0/488239353 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ff8cc141a60 con 0x7ff8cc0a1150 2023-09-30T01:58:52.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.388+0000 7ff8c8ff9700 1 -- 172.21.15.55:0/488239353 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7ff8bc088840 con 0x7ff8cc0a1150 2023-09-30T01:58:52.391 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:52.392 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:52.393 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.388+0000 7ff8d19e3700 10 mgrc shutdown 2023-09-30T01:58:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.392+0000 7ff8d19e3700 1 -- 172.21.15.55:0/488239353 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff8b808e8b0 msgr2=0x7ff8b8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.392+0000 7ff8d19e3700 1 --2- 172.21.15.55:0/488239353 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff8b808e8b0 0x7ff8b8090d60 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff8c0011480 tx=0x7ff8c00091a0 comp rx=0 tx=0).stop 2023-09-30T01:58:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.392+0000 7ff8d19e3700 1 -- 172.21.15.55:0/488239353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc0a1150 msgr2=0x7ff8cc09b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.392+0000 7ff8d19e3700 1 --2- 172.21.15.55:0/488239353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc0a1150 0x7ff8cc09b660 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7ff8bc00cb10 tx=0x7ff8bc0017b0 comp rx=0 tx=0).stop 2023-09-30T01:58:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.392+0000 7ff8d19e3700 1 -- 172.21.15.55:0/488239353 shutdown_connections 2023-09-30T01:58:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.392+0000 7ff8d19e3700 1 --2- 172.21.15.55:0/488239353 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7ff8cc13e6f0 0x7ff8cc13ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.392+0000 7ff8d19e3700 1 --2- 172.21.15.55:0/488239353 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7ff8cc0a1150 0x7ff8cc09b660 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.392+0000 7ff8d19e3700 1 --2- 172.21.15.55:0/488239353 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7ff8b808e8b0 0x7ff8b8090d60 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.392+0000 7ff8d19e3700 1 --2- 172.21.15.55:0/488239353 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7ff8cc0a0d80 0x7ff8cc140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:52.394 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.392+0000 7ff8d19e3700 1 -- 172.21.15.55:0/488239353 >> 172.21.15.55:0/488239353 conn(0x7ff8cc0b23d0 msgr2=0x7ff8cc1455e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.392+0000 7ff8d19e3700 1 -- 172.21.15.55:0/488239353 shutdown_connections 2023-09-30T01:58:52.395 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:52.392+0000 7ff8d19e3700 1 -- 172.21.15.55:0/488239353 wait complete. 2023-09-30T01:58:55.406 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:55.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.516+0000 7fa3c359e700 1 Processor -- start 2023-09-30T01:58:55.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.516+0000 7fa3c359e700 1 -- start start 2023-09-30T01:58:55.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.516+0000 7fa3c359e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fa3c4140b10 0x7fa3c40a5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:55.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.516+0000 7fa3c359e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3c4145390 0x7fa3c4147770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:55.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.516+0000 7fa3c359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3c40a58d0 con 0x7fa3c40affa0 2023-09-30T01:58:55.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.516+0000 7fa3c359e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c40a56d0 con 0x7fa3c4145390 2023-09-30T01:58:55.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.516+0000 7fa3c359e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3c406d830 con 0x7fa3c4140b10 2023-09-30T01:58:55.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.516+0000 7fa3c2d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3c4145390 0x7fa3c4147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:55.521 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.516+0000 7fa3c2d9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa3c4145390 0x7fa3c4147770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:46458/0 (socket says 172.21.15.55:46458) 2023-09-30T01:58:55.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.516+0000 7fa3c2d9d700 1 -- 172.21.15.55:0/3462117343 learned_addr learned my addr 172.21.15.55:0/3462117343 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:55.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.516+0000 7fa3c259c700 1 --2- 172.21.15.55:0/3462117343 >> v2:172.21.15.133:3300/0 conn(0x7fa3c4140b10 0x7fa3c40a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:55.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.516+0000 7fa3c2d9d700 1 -- 172.21.15.55:0/3462117343 >> v2:172.21.15.133:3300/0 conn(0x7fa3c4140b10 msgr2=0x7fa3c40a5190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:55.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.516+0000 7fa3c2d9d700 1 --2- 172.21.15.55:0/3462117343 >> v2:172.21.15.133:3300/0 conn(0x7fa3c4140b10 0x7fa3c40a5190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:55.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.516+0000 7fa3c2d9d700 1 -- 172.21.15.55:0/3462117343 >> v1:172.21.15.133:6789/0 conn(0x7fa3c40affa0 legacy=0x7fa3c406d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:55.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c2d9d700 1 -- 172.21.15.55:0/3462117343 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4140180 con 0x7fa3c4145390 2023-09-30T01:58:55.522 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c2d9d700 1 --2- 172.21.15.55:0/3462117343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c4145390 0x7fa3c4147770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa3c404be20 tx=0x7fa3bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=671d9968741083b9 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c159a700 1 -- 172.21.15.55:0/3462117343 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc00e070 con 0x7fa3c4145390 2023-09-30T01:58:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c159a700 1 -- 172.21.15.55:0/3462117343 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc00ba20 con 0x7fa3c4145390 2023-09-30T01:58:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c159a700 1 -- 172.21.15.55:0/3462117343 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc0092e0 con 0x7fa3c4145390 2023-09-30T01:58:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c359e700 1 -- 172.21.15.55:0/3462117343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c4145390 msgr2=0x7fa3c4147770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c359e700 1 --2- 172.21.15.55:0/3462117343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c4145390 0x7fa3c4147770 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa3c404be20 tx=0x7fa3bc009840 comp rx=0 tx=0).stop 2023-09-30T01:58:55.523 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c359e700 1 -- 172.21.15.55:0/3462117343 shutdown_connections 2023-09-30T01:58:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c359e700 1 --2- 172.21.15.55:0/3462117343 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c4145390 0x7fa3c4147770 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c359e700 1 --2- 172.21.15.55:0/3462117343 >> v2:172.21.15.133:3300/0 conn(0x7fa3c4140b10 0x7fa3c40a5190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c359e700 1 -- 172.21.15.55:0/3462117343 >> 172.21.15.55:0/3462117343 conn(0x7fa3c40681b0 msgr2=0x7fa3c40685b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c359e700 1 -- 172.21.15.55:0/3462117343 shutdown_connections 2023-09-30T01:58:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c359e700 1 -- 172.21.15.55:0/3462117343 wait complete. 2023-09-30T01:58:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c359e700 1 Processor -- start 2023-09-30T01:58:55.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.520+0000 7fa3c359e700 1 -- start start 2023-09-30T01:58:55.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c359e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c40affa0 0x7fa3c40aa7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:55.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c4140b10 0x7fa3c40abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:55.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c359e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa3c4145390 0x7fa3c4145ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:55.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c359e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c40ac2f0 con 0x7fa3c40affa0 2023-09-30T01:58:55.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c413b790 con 0x7fa3c4140b10 2023-09-30T01:58:55.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c359e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3c413ba50 con 0x7fa3c4145390 2023-09-30T01:58:55.527 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c2d9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa3c4145390 0x7fa3c4145ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c2d9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa3c4145390 0x7fa3c4145ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:45724/0 (socket says 172.21.15.55:45724) 2023-09-30T01:58:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c2d9d700 1 -- 172.21.15.55:0/3032474713 learned_addr learned my addr 172.21.15.55:0/3032474713 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c259c700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c40affa0 0x7fa3c40aa7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c1d9b700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c4140b10 0x7fa3c40abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c2d9d700 1 -- 172.21.15.55:0/3032474713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c4140b10 msgr2=0x7fa3c40abdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c2d9d700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c4140b10 0x7fa3c40abdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c2d9d700 1 -- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c40affa0 msgr2=0x7fa3c40aa7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:55.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c2d9d700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c40affa0 0x7fa3c40aa7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c2d9d700 1 -- 172.21.15.55:0/3032474713 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3bc009ae0 con 0x7fa3c4145390 2023-09-30T01:58:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c259c700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c40affa0 0x7fa3c40aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:58:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c2d9d700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa3c4145390 0x7fa3c4145ae0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0072f0 tx=0x7fa3bc018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3b27fc700 1 -- 172.21.15.55:0/3032474713 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc008c60 con 0x7fa3c4145390 2023-09-30T01:58:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3b27fc700 1 -- 172.21.15.55:0/3032474713 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3bc008de0 con 0x7fa3c4145390 2023-09-30T01:58:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c359e700 1 -- 172.21.15.55:0/3032474713 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3c413a9a0 con 0x7fa3c4145390 2023-09-30T01:58:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3b27fc700 1 -- 172.21.15.55:0/3032474713 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc01d670 con 0x7fa3c4145390 2023-09-30T01:58:55.529 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c359e700 1 -- 172.21.15.55:0/3032474713 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3c4146240 con 0x7fa3c4145390 2023-09-30T01:58:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.524+0000 7fa3c359e700 1 -- 172.21.15.55:0/3032474713 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3c4146430 con 0x7fa3c4145390 2023-09-30T01:58:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.528+0000 7fa3b27fc700 1 -- 172.21.15.55:0/3032474713 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fa3bc003040 con 0x7fa3c4145390 2023-09-30T01:58:55.530 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.528+0000 7fa3b27fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.528+0000 7fa3b27fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.528+0000 7fa3b27fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.528+0000 7fa3b27fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.528+0000 7fa3b27fc700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa3a408e8e0 0x7fa3a4090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.528+0000 7fa3c259c700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa3a408e8e0 0x7fa3a4090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:55.531 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.528+0000 7fa3b27fc700 1 -- 172.21.15.55:0/3032474713 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fa3bc0b68b0 con 0x7fa3c4145390 2023-09-30T01:58:55.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.528+0000 7fa3c259c700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa3a408e8e0 0x7fa3a4090d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009d80 tx=0x7fa3b8008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:55.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.536+0000 7fa3b27fc700 1 -- 172.21.15.55:0/3032474713 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa3bc087250 con 0x7fa3c4145390 2023-09-30T01:58:55.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.732+0000 7fa3c359e700 1 -- 172.21.15.55:0/3032474713 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa3c4064440 con 0x7fa3c4145390 2023-09-30T01:58:55.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.732+0000 7fa3b27fc700 1 -- 172.21.15.55:0/3032474713 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa3bc08a870 con 0x7fa3c4145390 2023-09-30T01:58:55.735 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:55.735 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:55.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.736+0000 7fa3c359e700 10 mgrc shutdown 2023-09-30T01:58:55.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.736+0000 7fa3c359e700 1 -- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa3a408e8e0 msgr2=0x7fa3a4090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:55.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.736+0000 7fa3c359e700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa3a408e8e0 0x7fa3a4090d90 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fa3b8009d80 tx=0x7fa3b8008040 comp rx=0 tx=0).stop 2023-09-30T01:58:55.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.736+0000 7fa3c359e700 1 -- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa3c4145390 msgr2=0x7fa3c4145ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:55.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.736+0000 7fa3c359e700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa3c4145390 0x7fa3c4145ae0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc0072f0 tx=0x7fa3bc018000 comp rx=0 tx=0).stop 2023-09-30T01:58:55.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.736+0000 7fa3c359e700 1 -- 172.21.15.55:0/3032474713 shutdown_connections 2023-09-30T01:58:55.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.736+0000 7fa3c359e700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa3a408e8e0 0x7fa3a4090d90 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:55.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.736+0000 7fa3c359e700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa3c4145390 0x7fa3c4145ae0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.736+0000 7fa3c359e700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa3c4140b10 0x7fa3c40abdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.736+0000 7fa3c359e700 1 --2- 172.21.15.55:0/3032474713 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa3c40affa0 0x7fa3c40aa7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.736+0000 7fa3c359e700 1 -- 172.21.15.55:0/3032474713 >> 172.21.15.55:0/3032474713 conn(0x7fa3c40681b0 msgr2=0x7fa3c406cf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.736+0000 7fa3c359e700 1 -- 172.21.15.55:0/3032474713 shutdown_connections 2023-09-30T01:58:55.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:55.736+0000 7fa3c359e700 1 -- 172.21.15.55:0/3032474713 wait complete. 2023-09-30T01:58:58.750 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:58:58.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.860+0000 7fac7f59e700 1 Processor -- start 2023-09-30T01:58:58.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.860+0000 7fac7f59e700 1 -- start start 2023-09-30T01:58:58.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.860+0000 7fac7f59e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac800a4480 0x7fac8006b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:58.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.860+0000 7fac7f59e700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fac80136030 0x7fac80136490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:58.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.860+0000 7fac7f59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac800a38e0 con 0x7fac800a9130 2023-09-30T01:58:58.866 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.860+0000 7fac7f59e700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac8006bae0 con 0x7fac80136030 2023-09-30T01:58:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.860+0000 7fac7f59e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac800a69c0 con 0x7fac800a4480 2023-09-30T01:58:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.860+0000 7fac7dd9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac800a4480 0x7fac8006b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.860+0000 7fac7dd9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac800a4480 0x7fac8006b5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:45736/0 (socket says 172.21.15.55:45736) 2023-09-30T01:58:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.860+0000 7fac7dd9b700 1 -- 172.21.15.55:0/3433037560 learned_addr learned my addr 172.21.15.55:0/3433037560 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.860+0000 7fac7ed9d700 1 --2- 172.21.15.55:0/3433037560 >> v2:172.21.15.133:3300/0 conn(0x7fac80136030 0x7fac80136490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7dd9b700 1 -- 172.21.15.55:0/3433037560 >> v2:172.21.15.133:3300/0 conn(0x7fac80136030 msgr2=0x7fac80136490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:58:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7dd9b700 1 --2- 172.21.15.55:0/3433037560 >> v2:172.21.15.133:3300/0 conn(0x7fac80136030 0x7fac80136490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7dd9b700 1 -- 172.21.15.55:0/3433037560 >> v1:172.21.15.133:6789/0 conn(0x7fac800a9130 legacy=0x7fac800a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7dd9b700 1 -- 172.21.15.55:0/3433037560 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac800a9500 con 0x7fac800a4480 2023-09-30T01:58:58.867 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7ed9d700 1 --2- 172.21.15.55:0/3433037560 >> v2:172.21.15.133:3300/0 conn(0x7fac80136030 0x7fac80136490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:58:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7dd9b700 1 --2- 172.21.15.55:0/3433037560 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac800a4480 0x7fac8006b5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac740099b0 tx=0x7fac74009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c7fff7934bb12721 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:58.868 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7d59a700 1 -- 172.21.15.55:0/3433037560 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7400b860 con 0x7fac800a4480 2023-09-30T01:58:58.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7d59a700 1 -- 172.21.15.55:0/3433037560 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7400b9c0 con 0x7fac800a4480 2023-09-30T01:58:58.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7d59a700 1 -- 172.21.15.55:0/3433037560 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7400bd60 con 0x7fac800a4480 2023-09-30T01:58:58.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7f59e700 1 -- 172.21.15.55:0/3433037560 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac800a4480 msgr2=0x7fac8006b5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:58.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7f59e700 1 --2- 172.21.15.55:0/3433037560 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac800a4480 0x7fac8006b5a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fac740099b0 tx=0x7fac74009250 comp rx=0 tx=0).stop 2023-09-30T01:58:58.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7f59e700 1 -- 172.21.15.55:0/3433037560 shutdown_connections 2023-09-30T01:58:58.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7f59e700 1 --2- 172.21.15.55:0/3433037560 >> v2:172.21.15.133:3300/0 conn(0x7fac80136030 0x7fac80136490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:58.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7f59e700 1 --2- 172.21.15.55:0/3433037560 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac800a4480 0x7fac8006b5a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:58.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7f59e700 1 -- 172.21.15.55:0/3433037560 >> 172.21.15.55:0/3433037560 conn(0x7fac800b6940 msgr2=0x7fac800b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:58.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7f59e700 1 -- 172.21.15.55:0/3433037560 shutdown_connections 2023-09-30T01:58:58.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7f59e700 1 -- 172.21.15.55:0/3433037560 wait complete. 2023-09-30T01:58:58.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7f59e700 1 Processor -- start 2023-09-30T01:58:58.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.864+0000 7fac7f59e700 1 -- start start 2023-09-30T01:58:58.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7f59e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac800a4480 0x7fac801320f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:58.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7f59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac800a9130 0x7fac8012da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:58.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7f59e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac80136030 0x7fac8012df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:58.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7f59e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8012e4d0 con 0x7fac80136030 2023-09-30T01:58:58.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7f59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac8012f540 con 0x7fac800a9130 2023-09-30T01:58:58.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7f59e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac80135e90 con 0x7fac800a4480 2023-09-30T01:58:58.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7e59c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac800a4480 0x7fac801320f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:58.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7e59c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac800a4480 0x7fac801320f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:45748/0 (socket says 172.21.15.55:45748) 2023-09-30T01:58:58.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7e59c700 1 -- 172.21.15.55:0/2834232117 learned_addr learned my addr 172.21.15.55:0/2834232117 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:58:58.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7ed9d700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac80136030 0x7fac8012df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:58.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7dd9b700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac800a9130 0x7fac8012da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:58.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7e59c700 1 -- 172.21.15.55:0/2834232117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac800a9130 msgr2=0x7fac8012da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:58.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7e59c700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac800a9130 0x7fac8012da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:58.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7e59c700 1 -- 172.21.15.55:0/2834232117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac80136030 msgr2=0x7fac8012df90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:58.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7e59c700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac80136030 0x7fac8012df90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:58.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7e59c700 1 -- 172.21.15.55:0/2834232117 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac740094f0 con 0x7fac800a4480 2023-09-30T01:58:58.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7dd9b700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac800a9130 0x7fac8012da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:58:58.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7e59c700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac800a4480 0x7fac801320f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fac7800cb10 tx=0x7fac780017b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:58.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac6e7fc700 1 -- 172.21.15.55:0/2834232117 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7800a760 con 0x7fac800a4480 2023-09-30T01:58:58.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac6e7fc700 1 -- 172.21.15.55:0/2834232117 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac7800a8e0 con 0x7fac800a4480 2023-09-30T01:58:58.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7f59e700 1 -- 172.21.15.55:0/2834232117 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac8012f770 con 0x7fac800a4480 2023-09-30T01:58:58.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac6e7fc700 1 -- 172.21.15.55:0/2834232117 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac7800aca0 con 0x7fac800a4480 2023-09-30T01:58:58.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.868+0000 7fac7f59e700 1 -- 172.21.15.55:0/2834232117 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac8012e910 con 0x7fac800a4480 2023-09-30T01:58:58.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.872+0000 7fac7f59e700 1 -- 172.21.15.55:0/2834232117 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac80064440 con 0x7fac800a4480 2023-09-30T01:58:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.872+0000 7fac6e7fc700 1 -- 172.21.15.55:0/2834232117 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fac78003030 con 0x7fac800a4480 2023-09-30T01:58:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.872+0000 7fac6e7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:58:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.872+0000 7fac6e7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:58:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.872+0000 7fac6e7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.872+0000 7fac6e7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:58:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.872+0000 7fac6e7fc700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fac6008e8b0 0x7fac60090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:58:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.872+0000 7fac7dd9b700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fac6008e8b0 0x7fac60090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:58:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.872+0000 7fac6e7fc700 1 -- 172.21.15.55:0/2834232117 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fac780b4960 con 0x7fac800a4480 2023-09-30T01:58:58.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.872+0000 7fac7dd9b700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fac6008e8b0 0x7fac60090d60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fac740099b0 tx=0x7fac74017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:58:58.884 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:58.880+0000 7fac6e7fc700 1 -- 172.21.15.55:0/2834232117 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fac78085390 con 0x7fac800a4480 2023-09-30T01:58:59.079 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.076+0000 7fac7f59e700 1 -- 172.21.15.55:0/2834232117 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fac8006cba0 con 0x7fac800a4480 2023-09-30T01:58:59.080 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.076+0000 7fac6e7fc700 1 -- 172.21.15.55:0/2834232117 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fac780889b0 con 0x7fac800a4480 2023-09-30T01:58:59.080 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:58:59.080 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:58:59.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.080+0000 7fac7f59e700 10 mgrc shutdown 2023-09-30T01:58:59.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.080+0000 7fac7f59e700 1 -- 172.21.15.55:0/2834232117 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fac6008e8b0 msgr2=0x7fac60090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:59.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.080+0000 7fac7f59e700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fac6008e8b0 0x7fac60090d60 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fac740099b0 tx=0x7fac74017000 comp rx=0 tx=0).stop 2023-09-30T01:58:59.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.080+0000 7fac7f59e700 1 -- 172.21.15.55:0/2834232117 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac800a4480 msgr2=0x7fac801320f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:58:59.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.080+0000 7fac7f59e700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac800a4480 0x7fac801320f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fac7800cb10 tx=0x7fac780017b0 comp rx=0 tx=0).stop 2023-09-30T01:58:59.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.080+0000 7fac7f59e700 1 -- 172.21.15.55:0/2834232117 shutdown_connections 2023-09-30T01:58:59.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.080+0000 7fac7f59e700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fac80136030 0x7fac8012df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:59.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.080+0000 7fac7f59e700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fac800a9130 0x7fac8012da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:59.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.080+0000 7fac7f59e700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fac6008e8b0 0x7fac60090d60 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:59.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.080+0000 7fac7f59e700 1 --2- 172.21.15.55:0/2834232117 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fac800a4480 0x7fac801320f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:58:59.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.080+0000 7fac7f59e700 1 -- 172.21.15.55:0/2834232117 >> 172.21.15.55:0/2834232117 conn(0x7fac800b6940 msgr2=0x7fac800a7f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:58:59.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.080+0000 7fac7f59e700 1 -- 172.21.15.55:0/2834232117 shutdown_connections 2023-09-30T01:58:59.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:58:59.080+0000 7fac7f59e700 1 -- 172.21.15.55:0/2834232117 wait complete. 2023-09-30T01:59:02.100 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:02.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10c67b700 1 Processor -- start 2023-09-30T01:59:02.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10c67b700 1 -- start start 2023-09-30T01:59:02.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10c67b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1040b3060 0x7fa1040a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:02.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10c67b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fa1040a7f20 0x7fa10413e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:02.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10c67b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1040b3430 con 0x7fa10413e5f0 2023-09-30T01:59:02.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10c67b700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa10413b8f0 con 0x7fa1040a7f20 2023-09-30T01:59:02.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10c67b700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1040a4b60 con 0x7fa1040b3060 2023-09-30T01:59:02.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10a417700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1040b3060 0x7fa1040a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:02.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10a417700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1040b3060 0x7fa1040a6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:39018/0 (socket says 172.21.15.55:39018) 2023-09-30T01:59:02.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10a417700 1 -- 172.21.15.55:0/207700469 learned_addr learned my addr 172.21.15.55:0/207700469 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:02.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10ac18700 1 --2- 172.21.15.55:0/207700469 >> v2:172.21.15.55:3300/0 conn(0x7fa1040a7f20 0x7fa10413e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:02.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10a417700 1 -- 172.21.15.55:0/207700469 >> v2:172.21.15.55:3300/0 conn(0x7fa1040a7f20 msgr2=0x7fa10413e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:02.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10a417700 1 --2- 172.21.15.55:0/207700469 >> v2:172.21.15.55:3300/0 conn(0x7fa1040a7f20 0x7fa10413e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:02.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10a417700 1 -- 172.21.15.55:0/207700469 >> v1:172.21.15.55:6789/0 conn(0x7fa10413e5f0 legacy=0x7fa1040a7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:02.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10a417700 1 -- 172.21.15.55:0/207700469 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa10413dfa0 con 0x7fa1040b3060 2023-09-30T01:59:02.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa10a417700 1 --2- 172.21.15.55:0/207700469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1040b3060 0x7fa1040a6120 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009f20 tx=0x7fa0fc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f00835071585b15f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa109415700 1 -- 172.21.15.55:0/207700469 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc00e070 con 0x7fa1040b3060 2023-09-30T01:59:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa109415700 1 -- 172.21.15.55:0/207700469 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa0fc00b9d0 con 0x7fa1040b3060 2023-09-30T01:59:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.212+0000 7fa109415700 1 -- 172.21.15.55:0/207700469 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0fc0092e0 con 0x7fa1040b3060 2023-09-30T01:59:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 -- 172.21.15.55:0/207700469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1040b3060 msgr2=0x7fa1040a6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 --2- 172.21.15.55:0/207700469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1040b3060 0x7fa1040a6120 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009f20 tx=0x7fa0fc009840 comp rx=0 tx=0).stop 2023-09-30T01:59:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 -- 172.21.15.55:0/207700469 shutdown_connections 2023-09-30T01:59:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 --2- 172.21.15.55:0/207700469 >> v2:172.21.15.55:3300/0 conn(0x7fa1040a7f20 0x7fa10413e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 --2- 172.21.15.55:0/207700469 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa1040b3060 0x7fa1040a6120 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 -- 172.21.15.55:0/207700469 >> 172.21.15.55:0/207700469 conn(0x7fa104068b00 msgr2=0x7fa1040b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:02.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 -- 172.21.15.55:0/207700469 shutdown_connections 2023-09-30T01:59:02.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 -- 172.21.15.55:0/207700469 wait complete. 2023-09-30T01:59:02.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 Processor -- start 2023-09-30T01:59:02.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 -- start start 2023-09-30T01:59:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1040a7f20 0x7fa10406c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:02.221 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1040b3060 0x7fa104141ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa10413e5f0 0x7fa1041393e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa104141200 con 0x7fa1040a7f20 2023-09-30T01:59:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa104141370 con 0x7fa1040b3060 2023-09-30T01:59:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1041420e0 con 0x7fa10413e5f0 2023-09-30T01:59:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10ac18700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa10413e5f0 0x7fa1041393e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10a417700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1040a7f20 0x7fa10406c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10ac18700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa10413e5f0 0x7fa1041393e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:39024/0 (socket says 172.21.15.55:39024) 2023-09-30T01:59:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10ac18700 1 -- 172.21.15.55:0/2174987384 learned_addr learned my addr 172.21.15.55:0/2174987384 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa109c16700 1 --2- 172.21.15.55:0/2174987384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1040b3060 0x7fa104141ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:02.222 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10ac18700 1 -- 172.21.15.55:0/2174987384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1040b3060 msgr2=0x7fa104141ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10ac18700 1 --2- 172.21.15.55:0/2174987384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1040b3060 0x7fa104141ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10ac18700 1 -- 172.21.15.55:0/2174987384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1040a7f20 msgr2=0x7fa10406c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10ac18700 1 --2- 172.21.15.55:0/2174987384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1040a7f20 0x7fa10406c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10ac18700 1 -- 172.21.15.55:0/2174987384 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0fc009ae0 con 0x7fa10413e5f0 2023-09-30T01:59:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10a417700 1 --2- 172.21.15.55:0/2174987384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1040a7f20 0x7fa10406c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:59:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10ac18700 1 --2- 172.21.15.55:0/2174987384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa10413e5f0 0x7fa1041393e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa10000ea20 tx=0x7fa1000091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa0fa7fc700 1 -- 172.21.15.55:0/2174987384 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10000c5e0 con 0x7fa10413e5f0 2023-09-30T01:59:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa0fa7fc700 1 -- 172.21.15.55:0/2174987384 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa10000c760 con 0x7fa10413e5f0 2023-09-30T01:59:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 -- 172.21.15.55:0/2174987384 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa10411c030 con 0x7fa10413e5f0 2023-09-30T01:59:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa0fa7fc700 1 -- 172.21.15.55:0/2174987384 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa10000cb20 con 0x7fa10413e5f0 2023-09-30T01:59:02.223 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.216+0000 7fa10c67b700 1 -- 172.21.15.55:0/2174987384 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa10411ad20 con 0x7fa10413e5f0 2023-09-30T01:59:02.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.220+0000 7fa10c67b700 1 -- 172.21.15.55:0/2174987384 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa104068300 con 0x7fa10413e5f0 2023-09-30T01:59:02.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.224+0000 7fa0fa7fc700 1 -- 172.21.15.55:0/2174987384 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fa100013470 con 0x7fa10413e5f0 2023-09-30T01:59:02.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.224+0000 7fa0fa7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.224+0000 7fa0fa7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.224+0000 7fa0fa7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.224+0000 7fa0fa7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.224+0000 7fa0fa7fc700 1 --2- 172.21.15.55:0/2174987384 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa0e808e8b0 0x7fa0e8090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.224+0000 7fa0fa7fc700 1 -- 172.21.15.55:0/2174987384 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fa1000b4d70 con 0x7fa10413e5f0 2023-09-30T01:59:02.226 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.224+0000 7fa10a417700 1 --2- 172.21.15.55:0/2174987384 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa0e808e8b0 0x7fa0e8090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:02.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.224+0000 7fa10a417700 1 --2- 172.21.15.55:0/2174987384 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa0e808e8b0 0x7fa0e8090d60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009880 tx=0x7fa0fc018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:02.234 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.232+0000 7fa0fa7fc700 1 -- 172.21.15.55:0/2174987384 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fa100085710 con 0x7fa10413e5f0 2023-09-30T01:59:02.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.420+0000 7fa10c67b700 1 -- 172.21.15.55:0/2174987384 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa1041414b0 con 0x7fa10413e5f0 2023-09-30T01:59:02.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.420+0000 7fa0fa7fc700 1 -- 172.21.15.55:0/2174987384 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fa100021100 con 0x7fa10413e5f0 2023-09-30T01:59:02.424 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:02.424 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:02.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.424+0000 7fa10c67b700 10 mgrc shutdown 2023-09-30T01:59:02.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.424+0000 7fa10c67b700 1 -- 172.21.15.55:0/2174987384 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa0e808e8b0 msgr2=0x7fa0e8090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:02.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.424+0000 7fa10c67b700 1 --2- 172.21.15.55:0/2174987384 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa0e808e8b0 0x7fa0e8090d60 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fa0fc009880 tx=0x7fa0fc018000 comp rx=0 tx=0).stop 2023-09-30T01:59:02.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.424+0000 7fa10c67b700 1 -- 172.21.15.55:0/2174987384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa10413e5f0 msgr2=0x7fa1041393e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:02.428 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.424+0000 7fa10c67b700 1 --2- 172.21.15.55:0/2174987384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa10413e5f0 0x7fa1041393e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa10000ea20 tx=0x7fa1000091a0 comp rx=0 tx=0).stop 2023-09-30T01:59:02.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.424+0000 7fa10c67b700 1 -- 172.21.15.55:0/2174987384 shutdown_connections 2023-09-30T01:59:02.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.424+0000 7fa10c67b700 1 --2- 172.21.15.55:0/2174987384 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fa0e808e8b0 0x7fa0e8090d60 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:02.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.424+0000 7fa10c67b700 1 --2- 172.21.15.55:0/2174987384 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fa10413e5f0 0x7fa1041393e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:02.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.424+0000 7fa10c67b700 1 --2- 172.21.15.55:0/2174987384 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fa1040b3060 0x7fa104141ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:02.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.424+0000 7fa10c67b700 1 --2- 172.21.15.55:0/2174987384 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fa1040a7f20 0x7fa10406c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:02.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.424+0000 7fa10c67b700 1 -- 172.21.15.55:0/2174987384 >> 172.21.15.55:0/2174987384 conn(0x7fa104068b00 msgr2=0x7fa1040677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:02.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.424+0000 7fa10c67b700 1 -- 172.21.15.55:0/2174987384 shutdown_connections 2023-09-30T01:59:02.429 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:02.424+0000 7fa10c67b700 1 -- 172.21.15.55:0/2174987384 wait complete. 2023-09-30T01:59:05.444 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:05.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.556+0000 7f4733fff700 1 Processor -- start 2023-09-30T01:59:05.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.556+0000 7f4733fff700 1 -- start start 2023-09-30T01:59:05.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.556+0000 7f4733fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47340a0400 0x7f4734148590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.556+0000 7f4733fff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47340687b0 con 0x7f47340683e0 2023-09-30T01:59:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.556+0000 7f4733fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47340a5650 con 0x7f47340a3220 2023-09-30T01:59:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.556+0000 7f4733fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47340a2e10 con 0x7f47340a0400 2023-09-30T01:59:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.556+0000 7f47337fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47340a0400 0x7f4734148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.556+0000 7f47337fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47340a0400 0x7f4734148590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:39026/0 (socket says 172.21.15.55:39026) 2023-09-30T01:59:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.556+0000 7f47337fe700 1 -- 172.21.15.55:0/1228491304 learned_addr learned my addr 172.21.15.55:0/1228491304 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f47337fe700 1 -- 172.21.15.55:0/1228491304 >> v1:172.21.15.133:6789/0 conn(0x7f47340a3220 legacy=0x7f473413c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f47337fe700 1 -- 172.21.15.55:0/1228491304 >> v1:172.21.15.55:6789/0 conn(0x7f47340683e0 legacy=0x7f47340a2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f47327fc700 1 -- 172.21.15.55:0/1228491304 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606749277 0 0) 0x7f47340687b0 con 0x7f47340683e0 2023-09-30T01:59:05.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f47337fe700 1 -- 172.21.15.55:0/1228491304 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47340a58f0 con 0x7f47340a0400 2023-09-30T01:59:05.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f47337fe700 1 --2- 172.21.15.55:0/1228491304 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47340a0400 0x7f4734148590 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f472c009f50 tx=0x7f472c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=751ac2b68b616c9e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:05.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f47327fc700 1 -- 172.21.15.55:0/1228491304 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c00e070 con 0x7f47340a0400 2023-09-30T01:59:05.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f47327fc700 1 -- 172.21.15.55:0/1228491304 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472c00bab0 con 0x7f47340a0400 2023-09-30T01:59:05.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f47327fc700 1 -- 172.21.15.55:0/1228491304 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472c0092e0 con 0x7f47340a0400 2023-09-30T01:59:05.566 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 -- 172.21.15.55:0/1228491304 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47340a0400 msgr2=0x7f4734148590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 --2- 172.21.15.55:0/1228491304 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47340a0400 0x7f4734148590 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f472c009f50 tx=0x7f472c009840 comp rx=0 tx=0).stop 2023-09-30T01:59:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 -- 172.21.15.55:0/1228491304 shutdown_connections 2023-09-30T01:59:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 --2- 172.21.15.55:0/1228491304 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47340a0400 0x7f4734148590 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 -- 172.21.15.55:0/1228491304 >> 172.21.15.55:0/1228491304 conn(0x7f4734062c70 msgr2=0x7f4734063070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 -- 172.21.15.55:0/1228491304 shutdown_connections 2023-09-30T01:59:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 -- 172.21.15.55:0/1228491304 wait complete. 2023-09-30T01:59:05.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 Processor -- start 2023-09-30T01:59:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 -- start start 2023-09-30T01:59:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47340683e0 0x7f473414fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47340a0400 0x7f473409d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47340a3220 0x7f473409c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473409d530 con 0x7f47340a0400 2023-09-30T01:59:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f473409df20 con 0x7f47340683e0 2023-09-30T01:59:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f4733fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47341503f0 con 0x7f47340a3220 2023-09-30T01:59:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f472bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47340a0400 0x7f473409d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f47337fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47340a3220 0x7f473409c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:05.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f47337fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47340a3220 0x7f473409c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:39040/0 (socket says 172.21.15.55:39040) 2023-09-30T01:59:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f472bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47340a0400 0x7f473409d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:55218/0 (socket says 172.21.15.55:55218) 2023-09-30T01:59:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.560+0000 7f47337fe700 1 -- 172.21.15.55:0/1610284866 learned_addr learned my addr 172.21.15.55:0/1610284866 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f4732ffd700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47340683e0 0x7f473414fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f472bfff700 1 -- 172.21.15.55:0/1610284866 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47340a3220 msgr2=0x7f473409c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f472bfff700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47340a3220 0x7f473409c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f472bfff700 1 -- 172.21.15.55:0/1610284866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47340683e0 msgr2=0x7f473414fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f472bfff700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47340683e0 0x7f473414fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f472bfff700 1 -- 172.21.15.55:0/1610284866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f472c009ae0 con 0x7f47340a0400 2023-09-30T01:59:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f4732ffd700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47340683e0 0x7f473414fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:59:05.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f47337fe700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47340a3220 0x7f473409c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:59:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f472bfff700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47340a0400 0x7f473409d9e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f471c00c4c0 tx=0x7f471c007f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f472affd700 1 -- 172.21.15.55:0/1610284866 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c011590 con 0x7f47340a0400 2023-09-30T01:59:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f472affd700 1 -- 172.21.15.55:0/1610284866 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f471c0116f0 con 0x7f47340a0400 2023-09-30T01:59:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f4733fff700 1 -- 172.21.15.55:0/1610284866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4734140cc0 con 0x7f47340a0400 2023-09-30T01:59:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f472affd700 1 -- 172.21.15.55:0/1610284866 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f471c011ab0 con 0x7f47340a0400 2023-09-30T01:59:05.570 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f4733fff700 1 -- 172.21.15.55:0/1610284866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f473409c730 con 0x7f47340a0400 2023-09-30T01:59:05.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.564+0000 7f4733fff700 1 -- 172.21.15.55:0/1610284866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f473409cc70 con 0x7f47340a0400 2023-09-30T01:59:05.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.568+0000 7f472affd700 1 -- 172.21.15.55:0/1610284866 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f471c01b3b0 con 0x7f47340a0400 2023-09-30T01:59:05.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.568+0000 7f472affd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:05.571 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.568+0000 7f472affd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:05.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.568+0000 7f472affd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:05.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.568+0000 7f472affd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:05.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.568+0000 7f472affd700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f471408e8b0 0x7f4714090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:05.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.568+0000 7f4732ffd700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f471408e8b0 0x7f4714090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:05.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.568+0000 7f472affd700 1 -- 172.21.15.55:0/1610284866 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f471c0b3ba0 con 0x7f47340a0400 2023-09-30T01:59:05.572 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.568+0000 7f4732ffd700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f471408e8b0 0x7f4714090d60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f47240011e0 tx=0x7f4724009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:05.578 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.576+0000 7f472affd700 1 -- 172.21.15.55:0/1610284866 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f473409cc70 con 0x7f47340a0400 2023-09-30T01:59:05.775 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.772+0000 7f4733fff700 1 -- 172.21.15.55:0/1610284866 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f473409d700 con 0x7f47340a0400 2023-09-30T01:59:05.776 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.772+0000 7f472affd700 1 -- 172.21.15.55:0/1610284866 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f473409d700 con 0x7f47340a0400 2023-09-30T01:59:05.776 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:05.776 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:05.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.776+0000 7f4733fff700 10 mgrc shutdown 2023-09-30T01:59:05.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.776+0000 7f4733fff700 1 -- 172.21.15.55:0/1610284866 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f471408e8b0 msgr2=0x7f4714090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:05.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.776+0000 7f4733fff700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f471408e8b0 0x7f4714090d60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f47240011e0 tx=0x7f4724009040 comp rx=0 tx=0).stop 2023-09-30T01:59:05.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.776+0000 7f4733fff700 1 -- 172.21.15.55:0/1610284866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47340a0400 msgr2=0x7f473409d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:05.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.776+0000 7f4733fff700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47340a0400 0x7f473409d9e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f471c00c4c0 tx=0x7f471c007f10 comp rx=0 tx=0).stop 2023-09-30T01:59:05.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.776+0000 7f4733fff700 1 -- 172.21.15.55:0/1610284866 shutdown_connections 2023-09-30T01:59:05.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.776+0000 7f4733fff700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f471408e8b0 0x7f4714090d60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:05.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.776+0000 7f4733fff700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f47340a3220 0x7f473409c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:05.779 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.776+0000 7f4733fff700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f47340a0400 0x7f473409d9e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:05.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.776+0000 7f4733fff700 1 --2- 172.21.15.55:0/1610284866 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f47340683e0 0x7f473414fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:05.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.776+0000 7f4733fff700 1 -- 172.21.15.55:0/1610284866 >> 172.21.15.55:0/1610284866 conn(0x7f4734062c70 msgr2=0x7f473409f460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:05.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.776+0000 7f4733fff700 1 -- 172.21.15.55:0/1610284866 shutdown_connections 2023-09-30T01:59:05.780 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:05.776+0000 7f4733fff700 1 -- 172.21.15.55:0/1610284866 wait complete. 2023-09-30T01:59:08.795 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:08.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.904+0000 7fdd5359e700 1 Processor -- start 2023-09-30T01:59:08.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.904+0000 7fdd5359e700 1 -- start start 2023-09-30T01:59:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.904+0000 7fdd5359e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd5413fb90 0x7fdd5406b7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.904+0000 7fdd5359e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd540a88d0 0x7fdd541436b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.904+0000 7fdd5359e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd5413ff60 con 0x7fdd540a8f70 2023-09-30T01:59:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.904+0000 7fdd5359e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd54143f00 con 0x7fdd540a88d0 2023-09-30T01:59:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.904+0000 7fdd5359e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd541441a0 con 0x7fdd5413fb90 2023-09-30T01:59:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.904+0000 7fdd5259c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd5413fb90 0x7fdd5406b7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.904+0000 7fdd51d9b700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdd540a88d0 0x7fdd541436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.904+0000 7fdd5259c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd5413fb90 0x7fdd5406b7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:39048/0 (socket says 172.21.15.55:39048) 2023-09-30T01:59:08.910 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.904+0000 7fdd5259c700 1 -- 172.21.15.55:0/1293310946 learned_addr learned my addr 172.21.15.55:0/1293310946 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:08.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5259c700 1 -- 172.21.15.55:0/1293310946 >> v2:172.21.15.55:3300/0 conn(0x7fdd540a88d0 msgr2=0x7fdd541436b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:08.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5259c700 1 --2- 172.21.15.55:0/1293310946 >> v2:172.21.15.55:3300/0 conn(0x7fdd540a88d0 0x7fdd541436b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:08.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5259c700 1 -- 172.21.15.55:0/1293310946 >> v1:172.21.15.133:6789/0 conn(0x7fdd540a8f70 legacy=0x7fdd540670a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:08.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5259c700 1 -- 172.21.15.55:0/1293310946 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd54143bf0 con 0x7fdd5413fb90 2023-09-30T01:59:08.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5259c700 1 --2- 172.21.15.55:0/1293310946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd5413fb90 0x7fdd5406b7b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009f20 tx=0x7fdd4c009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb49a92274daec7c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:08.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5159a700 1 -- 172.21.15.55:0/1293310946 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c00e070 con 0x7fdd5413fb90 2023-09-30T01:59:08.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5159a700 1 -- 172.21.15.55:0/1293310946 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4c00b990 con 0x7fdd5413fb90 2023-09-30T01:59:08.911 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5159a700 1 -- 172.21.15.55:0/1293310946 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4c0092e0 con 0x7fdd5413fb90 2023-09-30T01:59:08.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5359e700 1 -- 172.21.15.55:0/1293310946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd5413fb90 msgr2=0x7fdd5406b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:08.912 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5359e700 1 --2- 172.21.15.55:0/1293310946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd5413fb90 0x7fdd5406b7b0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009f20 tx=0x7fdd4c009840 comp rx=0 tx=0).stop 2023-09-30T01:59:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5359e700 1 -- 172.21.15.55:0/1293310946 shutdown_connections 2023-09-30T01:59:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5359e700 1 --2- 172.21.15.55:0/1293310946 >> v2:172.21.15.55:3300/0 conn(0x7fdd540a88d0 0x7fdd541436b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5359e700 1 --2- 172.21.15.55:0/1293310946 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd5413fb90 0x7fdd5406b7b0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5359e700 1 -- 172.21.15.55:0/1293310946 >> 172.21.15.55:0/1293310946 conn(0x7fdd540b44c0 msgr2=0x7fdd540b4890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5359e700 1 -- 172.21.15.55:0/1293310946 shutdown_connections 2023-09-30T01:59:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5359e700 1 -- 172.21.15.55:0/1293310946 wait complete. 2023-09-30T01:59:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5359e700 1 Processor -- start 2023-09-30T01:59:08.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.908+0000 7fdd5359e700 1 -- start start 2023-09-30T01:59:08.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd5359e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd540a88d0 0x7fdd54140940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:08.915 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd5359e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd540a8f70 0x7fdd54153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd5359e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd5413fb90 0x7fdd540ae960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd5359e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54153d90 con 0x7fdd5413fb90 2023-09-30T01:59:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd5359e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54154050 con 0x7fdd540a88d0 2023-09-30T01:59:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd5359e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd54153ad0 con 0x7fdd540a8f70 2023-09-30T01:59:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd51d9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd540a8f70 0x7fdd54153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd51d9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd540a8f70 0x7fdd54153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:39060/0 (socket says 172.21.15.55:39060) 2023-09-30T01:59:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd51d9b700 1 -- 172.21.15.55:0/2472833834 learned_addr learned my addr 172.21.15.55:0/2472833834 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd52d9d700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd5413fb90 0x7fdd540ae960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd5259c700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd540a88d0 0x7fdd54140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:08.916 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd51d9b700 1 -- 172.21.15.55:0/2472833834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd540a88d0 msgr2=0x7fdd54140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:08.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd51d9b700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd540a88d0 0x7fdd54140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:08.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd51d9b700 1 -- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd5413fb90 msgr2=0x7fdd540ae960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:08.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd51d9b700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd5413fb90 0x7fdd540ae960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:08.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd51d9b700 1 -- 172.21.15.55:0/2472833834 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4c009ae0 con 0x7fdd540a8f70 2023-09-30T01:59:08.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd52d9d700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd5413fb90 0x7fdd540ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:59:08.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd51d9b700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd540a8f70 0x7fdd54153590 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800e930 tx=0x7fdd480091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:08.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd427fc700 1 -- 172.21.15.55:0/2472833834 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800eed0 con 0x7fdd540a8f70 2023-09-30T01:59:08.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd427fc700 1 -- 172.21.15.55:0/2472833834 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4800c850 con 0x7fdd540a8f70 2023-09-30T01:59:08.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd5359e700 1 -- 172.21.15.55:0/2472833834 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd540b06a0 con 0x7fdd540a8f70 2023-09-30T01:59:08.917 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd427fc700 1 -- 172.21.15.55:0/2472833834 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4800cbf0 con 0x7fdd540a8f70 2023-09-30T01:59:08.918 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.912+0000 7fdd5359e700 1 -- 172.21.15.55:0/2472833834 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd5413bd50 con 0x7fdd540a8f70 2023-09-30T01:59:08.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.916+0000 7fdd5359e700 1 -- 172.21.15.55:0/2472833834 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5413bf10 con 0x7fdd540a8f70 2023-09-30T01:59:08.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.916+0000 7fdd427fc700 1 -- 172.21.15.55:0/2472833834 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fdd48013470 con 0x7fdd540a8f70 2023-09-30T01:59:08.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.916+0000 7fdd427fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:08.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.916+0000 7fdd427fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:08.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.916+0000 7fdd427fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:08.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.916+0000 7fdd427fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:08.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.916+0000 7fdd427fc700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdd3408e8b0 0x7fdd34090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:08.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.916+0000 7fdd5259c700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdd3408e8b0 0x7fdd34090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:08.919 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.916+0000 7fdd427fc700 1 -- 172.21.15.55:0/2472833834 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fdd480b4a40 con 0x7fdd540a8f70 2023-09-30T01:59:08.920 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.916+0000 7fdd5259c700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdd3408e8b0 0x7fdd34090d60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009880 tx=0x7fdd4c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:08.924 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:08.920+0000 7fdd427fc700 1 -- 172.21.15.55:0/2472833834 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdd5413bf10 con 0x7fdd540a8f70 2023-09-30T01:59:09.123 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.120+0000 7fdd5359e700 1 -- 172.21.15.55:0/2472833834 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdd5413bf10 con 0x7fdd540a8f70 2023-09-30T01:59:09.124 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.120+0000 7fdd427fc700 1 -- 172.21.15.55:0/2472833834 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fdd48017100 con 0x7fdd540a8f70 2023-09-30T01:59:09.124 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:09.124 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:09.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.124+0000 7fdd5359e700 10 mgrc shutdown 2023-09-30T01:59:09.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.124+0000 7fdd5359e700 1 -- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdd3408e8b0 msgr2=0x7fdd34090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:09.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.124+0000 7fdd5359e700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdd3408e8b0 0x7fdd34090d60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c009880 tx=0x7fdd4c017000 comp rx=0 tx=0).stop 2023-09-30T01:59:09.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.124+0000 7fdd5359e700 1 -- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd540a8f70 msgr2=0x7fdd54153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:09.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.124+0000 7fdd5359e700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd540a8f70 0x7fdd54153590 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdd4800e930 tx=0x7fdd480091a0 comp rx=0 tx=0).stop 2023-09-30T01:59:09.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.124+0000 7fdd5359e700 1 -- 172.21.15.55:0/2472833834 shutdown_connections 2023-09-30T01:59:09.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.124+0000 7fdd5359e700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdd5413fb90 0x7fdd540ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:09.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.124+0000 7fdd5359e700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdd3408e8b0 0x7fdd34090d60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:09.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.124+0000 7fdd5359e700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdd540a8f70 0x7fdd54153590 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:09.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.124+0000 7fdd5359e700 1 --2- 172.21.15.55:0/2472833834 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdd540a88d0 0x7fdd54140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:09.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.124+0000 7fdd5359e700 1 -- 172.21.15.55:0/2472833834 >> 172.21.15.55:0/2472833834 conn(0x7fdd540b44c0 msgr2=0x7fdd540b3bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:09.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.124+0000 7fdd5359e700 1 -- 172.21.15.55:0/2472833834 shutdown_connections 2023-09-30T01:59:09.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:09.124+0000 7fdd5359e700 1 -- 172.21.15.55:0/2472833834 wait complete. 2023-09-30T01:59:12.144 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d420e8700 1 Processor -- start 2023-09-30T01:59:12.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d420e8700 1 -- start start 2023-09-30T01:59:12.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d420e8700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3c13e5f0 0x7f1d3c13e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:12.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d420e8700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d3c0a7810 0x7f1d3c0a7c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:12.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d420e8700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d3c0b3430 con 0x7f1d3c0b3060 2023-09-30T01:59:12.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d420e8700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3c13b8f0 con 0x7f1d3c0a7810 2023-09-30T01:59:12.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d420e8700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0a6830 con 0x7f1d3c13e5f0 2023-09-30T01:59:12.256 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d3affd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3c13e5f0 0x7f1d3c13e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:12.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d3b7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1d3c0b3060 0x7f1d3c0a6120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41978/0 (socket says 172.21.15.55:41978) 2023-09-30T01:59:12.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d3bfff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f1d3c0a7810 0x7f1d3c0a7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:12.257 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d3b7fe700 1 -- 172.21.15.55:0/3646888321 learned_addr learned my addr 172.21.15.55:0/3646888321 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:59:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d3bfff700 1 -- 172.21.15.55:0/3646888321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3c13e5f0 msgr2=0x7f1d3c13e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d3bfff700 1 --2- 172.21.15.55:0/3646888321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3c13e5f0 0x7f1d3c13e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d3bfff700 1 -- 172.21.15.55:0/3646888321 >> v1:172.21.15.55:6789/0 conn(0x7f1d3c0b3060 legacy=0x7f1d3c0a6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d3a7fc700 1 -- 172.21.15.55:0/3646888321 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2767962069 0 0) 0x7f1d3c0b3430 con 0x7f1d3c0b3060 2023-09-30T01:59:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d3bfff700 1 -- 172.21.15.55:0/3646888321 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3c0a8190 con 0x7f1d3c0a7810 2023-09-30T01:59:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.252+0000 7f1d3affd700 1 --2- 172.21.15.55:0/3646888321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3c13e5f0 0x7f1d3c13e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:59:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.256+0000 7f1d3bfff700 1 --2- 172.21.15.55:0/3646888321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3c0a7810 0x7f1d3c0a7c50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009e60 tx=0x7f1d34009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df3e9aa6113f5d1d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.256+0000 7f1d3a7fc700 1 -- 172.21.15.55:0/3646888321 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3400e070 con 0x7f1d3c0a7810 2023-09-30T01:59:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.256+0000 7f1d3a7fc700 1 -- 172.21.15.55:0/3646888321 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3400bb60 con 0x7f1d3c0a7810 2023-09-30T01:59:12.259 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.256+0000 7f1d3a7fc700 1 -- 172.21.15.55:0/3646888321 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d34012430 con 0x7f1d3c0a7810 2023-09-30T01:59:12.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.256+0000 7f1d420e8700 1 -- 172.21.15.55:0/3646888321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3c0a7810 msgr2=0x7f1d3c0a7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:12.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.256+0000 7f1d420e8700 1 --2- 172.21.15.55:0/3646888321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3c0a7810 0x7f1d3c0a7c50 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f1d34009e60 tx=0x7f1d34009780 comp rx=0 tx=0).stop 2023-09-30T01:59:12.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.256+0000 7f1d420e8700 1 -- 172.21.15.55:0/3646888321 shutdown_connections 2023-09-30T01:59:12.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.256+0000 7f1d420e8700 1 --2- 172.21.15.55:0/3646888321 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3c0a7810 0x7f1d3c0a7c50 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:12.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.256+0000 7f1d420e8700 1 --2- 172.21.15.55:0/3646888321 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3c13e5f0 0x7f1d3c13e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:12.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.256+0000 7f1d420e8700 1 -- 172.21.15.55:0/3646888321 >> 172.21.15.55:0/3646888321 conn(0x7f1d3c068b00 msgr2=0x7f1d3c0b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:12.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.256+0000 7f1d420e8700 1 -- 172.21.15.55:0/3646888321 shutdown_connections 2023-09-30T01:59:12.260 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.256+0000 7f1d420e8700 1 -- 172.21.15.55:0/3646888321 wait complete. 2023-09-30T01:59:12.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.256+0000 7f1d420e8700 1 Processor -- start 2023-09-30T01:59:12.261 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.256+0000 7f1d420e8700 1 -- start start 2023-09-30T01:59:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d420e8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d3c0a7810 0x7f1d3c140fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d420e8700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3c0b3060 0x7f1d3c0aca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d420e8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3c13e5f0 0x7f1d3c0a8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d420e8700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c141dd0 con 0x7f1d3c13e5f0 2023-09-30T01:59:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d420e8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0a95e0 con 0x7f1d3c0a7810 2023-09-30T01:59:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d420e8700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3c0acf40 con 0x7f1d3c0b3060 2023-09-30T01:59:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d3affd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3c0b3060 0x7f1d3c0aca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d3bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3c13e5f0 0x7f1d3c0a8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:12.262 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d3affd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3c0b3060 0x7f1d3c0aca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:50374/0 (socket says 172.21.15.55:50374) 2023-09-30T01:59:12.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d3affd700 1 -- 172.21.15.55:0/1522187110 learned_addr learned my addr 172.21.15.55:0/1522187110 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:12.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d3bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3c13e5f0 0x7f1d3c0a8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60588/0 (socket says 172.21.15.55:60588) 2023-09-30T01:59:12.263 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d3b7fe700 1 --2- 172.21.15.55:0/1522187110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d3c0a7810 0x7f1d3c140fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d3affd700 1 -- 172.21.15.55:0/1522187110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d3c0a7810 msgr2=0x7f1d3c140fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d3affd700 1 --2- 172.21.15.55:0/1522187110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d3c0a7810 0x7f1d3c140fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d3affd700 1 -- 172.21.15.55:0/1522187110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3c13e5f0 msgr2=0x7f1d3c0a8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d3affd700 1 --2- 172.21.15.55:0/1522187110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3c13e5f0 0x7f1d3c0a8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d3affd700 1 -- 172.21.15.55:0/1522187110 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c009420 con 0x7f1d3c0b3060 2023-09-30T01:59:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d3affd700 1 --2- 172.21.15.55:0/1522187110 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3c0b3060 0x7f1d3c0aca00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00ec80 tx=0x7f1d2c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d237fe700 1 -- 172.21.15.55:0/1522187110 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00c7f0 con 0x7f1d3c0b3060 2023-09-30T01:59:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d237fe700 1 -- 172.21.15.55:0/1522187110 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c00c950 con 0x7f1d3c0b3060 2023-09-30T01:59:12.264 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d420e8700 1 -- 172.21.15.55:0/1522187110 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d34009a20 con 0x7f1d3c0b3060 2023-09-30T01:59:12.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d237fe700 1 -- 172.21.15.55:0/1522187110 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c00ccd0 con 0x7f1d3c0b3060 2023-09-30T01:59:12.265 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.260+0000 7f1d420e8700 1 -- 172.21.15.55:0/1522187110 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d3c0a90d0 con 0x7f1d3c0b3060 2023-09-30T01:59:12.266 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.264+0000 7f1d237fe700 1 -- 172.21.15.55:0/1522187110 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f1d2c013470 con 0x7f1d3c0b3060 2023-09-30T01:59:12.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.264+0000 7f1d237fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:12.267 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.264+0000 7f1d420e8700 1 -- 172.21.15.55:0/1522187110 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3c0a9380 con 0x7f1d3c0b3060 2023-09-30T01:59:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.264+0000 7f1d237fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.264+0000 7f1d237fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.264+0000 7f1d237fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.264+0000 7f1d237fe700 1 --2- 172.21.15.55:0/1522187110 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1d2808e830 0x7f1d28090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.264+0000 7f1d3b7fe700 1 --2- 172.21.15.55:0/1522187110 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1d2808e830 0x7f1d28090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.264+0000 7f1d237fe700 1 -- 172.21.15.55:0/1522187110 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f1d2c0b4dc0 con 0x7f1d3c0b3060 2023-09-30T01:59:12.268 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.264+0000 7f1d3b7fe700 1 --2- 172.21.15.55:0/1522187110 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1d2808e830 0x7f1d28090ce0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1d30007fd0 tx=0x7f1d30007d30 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:12.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.272+0000 7f1d237fe700 1 -- 172.21.15.55:0/1522187110 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f1d2c089280 con 0x7f1d3c0b3060 2023-09-30T01:59:12.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d420e8700 1 -- 172.21.15.55:0/1522187110 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1d3c0a9c50 con 0x7f1d3c0b3060 2023-09-30T01:59:12.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d237fe700 1 -- 172.21.15.55:0/1522187110 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f1d2c017100 con 0x7f1d3c0b3060 2023-09-30T01:59:12.474 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:12.474 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:12.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d420e8700 10 mgrc shutdown 2023-09-30T01:59:12.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d420e8700 1 -- 172.21.15.55:0/1522187110 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1d2808e830 msgr2=0x7f1d28090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:12.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d420e8700 1 --2- 172.21.15.55:0/1522187110 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1d2808e830 0x7f1d28090ce0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f1d30007fd0 tx=0x7f1d30007d30 comp rx=0 tx=0).stop 2023-09-30T01:59:12.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d420e8700 1 -- 172.21.15.55:0/1522187110 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3c0b3060 msgr2=0x7f1d3c0aca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:12.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d420e8700 1 --2- 172.21.15.55:0/1522187110 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3c0b3060 0x7f1d3c0aca00 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c00ec80 tx=0x7f1d2c0091a0 comp rx=0 tx=0).stop 2023-09-30T01:59:12.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d420e8700 1 -- 172.21.15.55:0/1522187110 shutdown_connections 2023-09-30T01:59:12.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d420e8700 1 --2- 172.21.15.55:0/1522187110 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f1d3c13e5f0 0x7f1d3c0a8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:12.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d420e8700 1 --2- 172.21.15.55:0/1522187110 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f1d2808e830 0x7f1d28090ce0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:12.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d420e8700 1 --2- 172.21.15.55:0/1522187110 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f1d3c0b3060 0x7f1d3c0aca00 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:12.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d420e8700 1 --2- 172.21.15.55:0/1522187110 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1d3c0a7810 0x7f1d3c140fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:12.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d420e8700 1 -- 172.21.15.55:0/1522187110 >> 172.21.15.55:0/1522187110 conn(0x7f1d3c068b00 msgr2=0x7f1d3c13c3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:12.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d420e8700 1 -- 172.21.15.55:0/1522187110 shutdown_connections 2023-09-30T01:59:12.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:12.472+0000 7f1d420e8700 1 -- 172.21.15.55:0/1522187110 wait complete. 2023-09-30T01:59:14.118 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:59:14.120 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:59:15.490 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:15.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.600+0000 7feb73fff700 1 Processor -- start 2023-09-30T01:59:15.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.600+0000 7feb73fff700 1 -- start start 2023-09-30T01:59:15.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.600+0000 7feb73fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb7406c570 0x7feb740b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:15.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.600+0000 7feb73fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7feb740b3800 0x7feb7413bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:15.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.600+0000 7feb73fff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb74140900 con 0x7feb7406c1a0 2023-09-30T01:59:15.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.600+0000 7feb73fff700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb74140ba0 con 0x7feb7406c570 2023-09-30T01:59:15.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.600+0000 7feb73fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb74140640 con 0x7feb740b3800 2023-09-30T01:59:15.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.600+0000 7feb72ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7feb7406c1a0 0x7feb7413ff30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41994/0 (socket says 172.21.15.55:41994) 2023-09-30T01:59:15.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.600+0000 7feb6a7fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7feb7406c570 0x7feb740b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:15.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.600+0000 7feb72ffd700 1 -- 172.21.15.55:0/3980462974 learned_addr learned my addr 172.21.15.55:0/3980462974 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:59:15.606 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb737fe700 1 --2- 172.21.15.55:0/3980462974 >> v2:172.21.15.133:3300/0 conn(0x7feb740b3800 0x7feb7413bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:15.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb727fc700 1 -- 172.21.15.55:0/3980462974 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2519392323 0 0) 0x7feb74140900 con 0x7feb7406c1a0 2023-09-30T01:59:15.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb727fc700 1 -- 172.21.15.55:0/3980462974 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb60003570 con 0x7feb7406c1a0 2023-09-30T01:59:15.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb6a7fc700 1 -- 172.21.15.55:0/3980462974 >> v2:172.21.15.133:3300/0 conn(0x7feb740b3800 msgr2=0x7feb7413bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:15.607 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb6a7fc700 1 --2- 172.21.15.55:0/3980462974 >> v2:172.21.15.133:3300/0 conn(0x7feb740b3800 0x7feb7413bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:15.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb6a7fc700 1 -- 172.21.15.55:0/3980462974 >> v1:172.21.15.55:6789/0 conn(0x7feb7406c1a0 legacy=0x7feb7413ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:15.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb727fc700 1 -- 172.21.15.55:0/3980462974 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1461676335 0 0) 0x7feb60003570 con 0x7feb7406c1a0 2023-09-30T01:59:15.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb6a7fc700 1 -- 172.21.15.55:0/3980462974 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb7406ca90 con 0x7feb7406c570 2023-09-30T01:59:15.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb6a7fc700 1 --2- 172.21.15.55:0/3980462974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb7406c570 0x7feb740b32c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feb740b4170 tx=0x7feb5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f41185438455c2c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:15.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb727fc700 1 -- 172.21.15.55:0/3980462974 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb64001470 con 0x7feb7406c570 2023-09-30T01:59:15.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb727fc700 1 -- 172.21.15.55:0/3980462974 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c011420 con 0x7feb7406c570 2023-09-30T01:59:15.608 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb727fc700 1 -- 172.21.15.55:0/3980462974 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c0117c0 con 0x7feb7406c570 2023-09-30T01:59:15.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb73fff700 1 -- 172.21.15.55:0/3980462974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb7406c570 msgr2=0x7feb740b32c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:15.609 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb73fff700 1 --2- 172.21.15.55:0/3980462974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb7406c570 0x7feb740b32c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7feb740b4170 tx=0x7feb5c0091a0 comp rx=0 tx=0).stop 2023-09-30T01:59:15.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb73fff700 1 -- 172.21.15.55:0/3980462974 shutdown_connections 2023-09-30T01:59:15.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb73fff700 1 --2- 172.21.15.55:0/3980462974 >> v2:172.21.15.133:3300/0 conn(0x7feb740b3800 0x7feb7413bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:15.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb73fff700 1 --2- 172.21.15.55:0/3980462974 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb7406c570 0x7feb740b32c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:15.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb73fff700 1 -- 172.21.15.55:0/3980462974 >> 172.21.15.55:0/3980462974 conn(0x7feb7406ab90 msgr2=0x7feb7406af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:15.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb73fff700 1 -- 172.21.15.55:0/3980462974 shutdown_connections 2023-09-30T01:59:15.610 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.604+0000 7feb73fff700 1 -- 172.21.15.55:0/3980462974 wait complete. 2023-09-30T01:59:15.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.608+0000 7feb73fff700 1 Processor -- start 2023-09-30T01:59:15.611 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.608+0000 7feb73fff700 1 -- start start 2023-09-30T01:59:15.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.608+0000 7feb73fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7406c1a0 0x7feb740ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:15.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.608+0000 7feb73fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb7406c570 0x7feb740a9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:15.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.608+0000 7feb73fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb740b3800 0x7feb74153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:15.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.608+0000 7feb73fff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7413f6c0 con 0x7feb7406c570 2023-09-30T01:59:15.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.608+0000 7feb73fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb740a9a20 con 0x7feb7406c1a0 2023-09-30T01:59:15.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.608+0000 7feb73fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb740a9680 con 0x7feb740b3800 2023-09-30T01:59:15.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.608+0000 7feb6a7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb7406c570 0x7feb740a9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:15.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.608+0000 7feb6a7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb7406c570 0x7feb740a9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60602/0 (socket says 172.21.15.55:60602) 2023-09-30T01:59:15.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.608+0000 7feb6a7fc700 1 -- 172.21.15.55:0/2001989229 learned_addr learned my addr 172.21.15.55:0/2001989229 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:15.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.608+0000 7feb737fe700 1 --2- 172.21.15.55:0/2001989229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb740b3800 0x7feb74153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:15.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.608+0000 7feb72ffd700 1 --2- 172.21.15.55:0/2001989229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7406c1a0 0x7feb740ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:15.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.612+0000 7feb6a7fc700 1 -- 172.21.15.55:0/2001989229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb740b3800 msgr2=0x7feb74153950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:15.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.612+0000 7feb6a7fc700 1 --2- 172.21.15.55:0/2001989229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb740b3800 0x7feb74153950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:15.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.612+0000 7feb6a7fc700 1 -- 172.21.15.55:0/2001989229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7406c1a0 msgr2=0x7feb740ac730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:15.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.612+0000 7feb6a7fc700 1 --2- 172.21.15.55:0/2001989229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7406c1a0 0x7feb740ac730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:15.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.612+0000 7feb6a7fc700 1 -- 172.21.15.55:0/2001989229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb5c009420 con 0x7feb7406c570 2023-09-30T01:59:15.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.612+0000 7feb6a7fc700 1 --2- 172.21.15.55:0/2001989229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb7406c570 0x7feb740a9140 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7feb5c002000 tx=0x7feb5c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:15.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.612+0000 7feb6b7fe700 1 -- 172.21.15.55:0/2001989229 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c01cab0 con 0x7feb7406c570 2023-09-30T01:59:15.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.612+0000 7feb6b7fe700 1 -- 172.21.15.55:0/2001989229 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb5c01cc10 con 0x7feb7406c570 2023-09-30T01:59:15.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.612+0000 7feb73fff700 1 -- 172.21.15.55:0/2001989229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7409f270 con 0x7feb7406c570 2023-09-30T01:59:15.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.612+0000 7feb6b7fe700 1 -- 172.21.15.55:0/2001989229 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb5c01a450 con 0x7feb7406c570 2023-09-30T01:59:15.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.612+0000 7feb73fff700 1 -- 172.21.15.55:0/2001989229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb74069080 con 0x7feb7406c570 2023-09-30T01:59:15.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.612+0000 7feb73fff700 1 -- 172.21.15.55:0/2001989229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7405ecb0 con 0x7feb7406c570 2023-09-30T01:59:15.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.616+0000 7feb6b7fe700 1 -- 172.21.15.55:0/2001989229 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7feb5c01a800 con 0x7feb7406c570 2023-09-30T01:59:15.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.616+0000 7feb6b7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.616+0000 7feb6b7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.616+0000 7feb6b7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:15.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.616+0000 7feb6b7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.616+0000 7feb6b7fe700 1 --2- 172.21.15.55:0/2001989229 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7feb5408e8b0 0x7feb54090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.616+0000 7feb6b7fe700 1 -- 172.21.15.55:0/2001989229 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7feb5c0b6560 con 0x7feb7406c570 2023-09-30T01:59:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.616+0000 7feb72ffd700 1 --2- 172.21.15.55:0/2001989229 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7feb5408e8b0 0x7feb54090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:15.619 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.616+0000 7feb72ffd700 1 --2- 172.21.15.55:0/2001989229 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7feb5408e8b0 0x7feb54090d60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feb640011e0 tx=0x7feb64001a00 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:15.627 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.624+0000 7feb6b7fe700 1 -- 172.21.15.55:0/2001989229 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7feb5c086ef0 con 0x7feb7406c570 2023-09-30T01:59:15.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb73fff700 1 -- 172.21.15.55:0/2001989229 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7feb7413c2e0 con 0x7feb7406c570 2023-09-30T01:59:15.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb6b7fe700 1 -- 172.21.15.55:0/2001989229 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7feb5c08a510 con 0x7feb7406c570 2023-09-30T01:59:15.830 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:15.831 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb73fff700 10 mgrc shutdown 2023-09-30T01:59:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb73fff700 1 -- 172.21.15.55:0/2001989229 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7feb5408e8b0 msgr2=0x7feb54090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb73fff700 1 --2- 172.21.15.55:0/2001989229 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7feb5408e8b0 0x7feb54090d60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7feb640011e0 tx=0x7feb64001a00 comp rx=0 tx=0).stop 2023-09-30T01:59:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb73fff700 1 -- 172.21.15.55:0/2001989229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb7406c570 msgr2=0x7feb740a9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb73fff700 1 --2- 172.21.15.55:0/2001989229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb7406c570 0x7feb740a9140 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7feb5c002000 tx=0x7feb5c016000 comp rx=0 tx=0).stop 2023-09-30T01:59:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb73fff700 1 -- 172.21.15.55:0/2001989229 shutdown_connections 2023-09-30T01:59:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb73fff700 1 --2- 172.21.15.55:0/2001989229 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7feb5408e8b0 0x7feb54090d60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:15.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb73fff700 1 --2- 172.21.15.55:0/2001989229 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7feb740b3800 0x7feb74153950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:15.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb73fff700 1 --2- 172.21.15.55:0/2001989229 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7feb7406c570 0x7feb740a9140 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:15.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb73fff700 1 --2- 172.21.15.55:0/2001989229 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7feb7406c1a0 0x7feb740ac730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:15.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb73fff700 1 -- 172.21.15.55:0/2001989229 >> 172.21.15.55:0/2001989229 conn(0x7feb7406ab90 msgr2=0x7feb740a1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:15.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb73fff700 1 -- 172.21.15.55:0/2001989229 shutdown_connections 2023-09-30T01:59:15.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:15.828+0000 7feb73fff700 1 -- 172.21.15.55:0/2001989229 wait complete. 2023-09-30T01:59:18.845 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f27888c8700 1 Processor -- start 2023-09-30T01:59:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f27888c8700 1 -- start start 2023-09-30T01:59:18.959 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f27888c8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f27840b3940 0x7f27840a88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:18.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f27888c8700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27840a8e40 con 0x7f27840670a0 2023-09-30T01:59:18.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f27888c8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27840b3d10 con 0x7f2784136060 2023-09-30T01:59:18.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f27888c8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2784067c90 con 0x7f27840b3940 2023-09-30T01:59:18.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f277bfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f27840670a0 0x7f27840674b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:42010/0 (socket says 172.21.15.55:42010) 2023-09-30T01:59:18.960 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f277bfff700 1 -- 172.21.15.55:0/2197091100 learned_addr learned my addr 172.21.15.55:0/2197091100 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:59:18.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f278259c700 1 --2- 172.21.15.55:0/2197091100 >> v2:172.21.15.133:3300/0 conn(0x7f27840b3940 0x7f27840a88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:18.962 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 -- 172.21.15.55:0/2197091100 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1593705394 0 0) 0x7f27840a8e40 con 0x7f27840670a0 2023-09-30T01:59:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 -- 172.21.15.55:0/2197091100 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2770003570 con 0x7f27840670a0 2023-09-30T01:59:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 -- 172.21.15.55:0/2197091100 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2381512476 0 0) 0x7f2770003570 con 0x7f27840670a0 2023-09-30T01:59:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 -- 172.21.15.55:0/2197091100 >> v2:172.21.15.133:3300/0 conn(0x7f27840b3940 msgr2=0x7f27840a88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 --2- 172.21.15.55:0/2197091100 >> v2:172.21.15.133:3300/0 conn(0x7f27840b3940 0x7f27840a88d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 -- 172.21.15.55:0/2197091100 >> v1:172.21.15.133:6789/0 conn(0x7f2784136060 legacy=0x7f27841364b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 -- 172.21.15.55:0/2197091100 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2784067f50 con 0x7f27840670a0 2023-09-30T01:59:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 -- 172.21.15.55:0/2197091100 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 254224620 0 0) 0x7f276c001470 con 0x7f27840670a0 2023-09-30T01:59:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 -- 172.21.15.55:0/2197091100 >> v1:172.21.15.55:6789/0 conn(0x7f27840670a0 legacy=0x7f27840674b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 --2- 172.21.15.55:0/2197091100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2770003a60 0x7f2770003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 --2- 172.21.15.55:0/2197091100 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2770004810 0x7f2770004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:18.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 --2- 172.21.15.55:0/2197091100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27700051c0 0x7f277000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:18.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 -- 172.21.15.55:0/2197091100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2784067c90 con 0x7f2770003a60 2023-09-30T01:59:18.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 -- 172.21.15.55:0/2197091100 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277000c0e0 con 0x7f27700051c0 2023-09-30T01:59:18.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f2781d9b700 1 -- 172.21.15.55:0/2197091100 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277000c2a0 con 0x7f2770004810 2023-09-30T01:59:18.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f278259c700 1 --2- 172.21.15.55:0/2197091100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2770003a60 0x7f2770003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:18.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.956+0000 7f277bfff700 1 --2- 172.21.15.55:0/2197091100 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2770004810 0x7f2770004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:18.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f2782d9d700 1 --2- 172.21.15.55:0/2197091100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27700051c0 0x7f277000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:18.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f278259c700 1 -- 172.21.15.55:0/2197091100 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2770004810 msgr2=0x7f2770004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:18.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f278259c700 1 --2- 172.21.15.55:0/2197091100 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2770004810 0x7f2770004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:18.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f278259c700 1 -- 172.21.15.55:0/2197091100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27700051c0 msgr2=0x7f277000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:18.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f278259c700 1 --2- 172.21.15.55:0/2197091100 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27700051c0 0x7f277000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:18.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f278259c700 1 -- 172.21.15.55:0/2197091100 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2770003570 con 0x7f2770003a60 2023-09-30T01:59:18.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f2782d9d700 1 -- 172.21.15.55:0/2197091100 reap_dead start 2023-09-30T01:59:18.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f277bfff700 1 --2- 172.21.15.55:0/2197091100 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2770004810 0x7f2770004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:59:18.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f278259c700 1 --2- 172.21.15.55:0/2197091100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2770003a60 0x7f2770003e30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f277400bb90 tx=0x7f2774008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418d946d65e1f858 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:18.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f2781d9b700 1 -- 172.21.15.55:0/2197091100 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400d5d0 con 0x7f2770003a60 2023-09-30T01:59:18.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f2781d9b700 1 -- 172.21.15.55:0/2197091100 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277400d730 con 0x7f2770003a60 2023-09-30T01:59:18.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f2781d9b700 1 -- 172.21.15.55:0/2197091100 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277400daf0 con 0x7f2770003a60 2023-09-30T01:59:18.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f27888c8700 1 -- 172.21.15.55:0/2197091100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2770003a60 msgr2=0x7f2770003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:18.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f27888c8700 1 --2- 172.21.15.55:0/2197091100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2770003a60 0x7f2770003e30 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f277400bb90 tx=0x7f2774008040 comp rx=0 tx=0).stop 2023-09-30T01:59:18.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f27888c8700 1 -- 172.21.15.55:0/2197091100 shutdown_connections 2023-09-30T01:59:18.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f27888c8700 1 --2- 172.21.15.55:0/2197091100 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2770003a60 0x7f2770003e30 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:18.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f27888c8700 1 -- 172.21.15.55:0/2197091100 >> 172.21.15.55:0/2197091100 conn(0x7f2784062d90 msgr2=0x7f2784063190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:18.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f27888c8700 1 -- 172.21.15.55:0/2197091100 shutdown_connections 2023-09-30T01:59:18.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.960+0000 7f27888c8700 1 -- 172.21.15.55:0/2197091100 wait complete. 2023-09-30T01:59:18.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f27888c8700 1 Processor -- start 2023-09-30T01:59:18.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f27888c8700 1 -- start start 2023-09-30T01:59:18.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f27888c8700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2770003a60 0x7f27840ad010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:18.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f27888c8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2784131f20 0x7f2784150170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:18.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f27888c8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27841506b0 0x7f27840ab260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:18.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f27888c8700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27840ad5c0 con 0x7f2784131f20 2023-09-30T01:59:18.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f27888c8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27840ac640 con 0x7f27841506b0 2023-09-30T01:59:18.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f27888c8700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2784150b20 con 0x7f2770003a60 2023-09-30T01:59:18.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f278259c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2770003a60 0x7f27840ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:18.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f278259c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2770003a60 0x7f27840ad010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:50398/0 (socket says 172.21.15.55:50398) 2023-09-30T01:59:18.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f278259c700 1 -- 172.21.15.55:0/516521364 learned_addr learned my addr 172.21.15.55:0/516521364 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:18.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f277bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2784131f20 0x7f2784150170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:18.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f2782d9d700 1 --2- 172.21.15.55:0/516521364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27841506b0 0x7f27840ab260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:18.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f278259c700 1 -- 172.21.15.55:0/516521364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27841506b0 msgr2=0x7f27840ab260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:18.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f278259c700 1 --2- 172.21.15.55:0/516521364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27841506b0 0x7f27840ab260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:18.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f278259c700 1 -- 172.21.15.55:0/516521364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2784131f20 msgr2=0x7f2784150170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:18.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f278259c700 1 --2- 172.21.15.55:0/516521364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2784131f20 0x7f2784150170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:18.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f278259c700 1 -- 172.21.15.55:0/516521364 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2784150f30 con 0x7f2770003a60 2023-09-30T01:59:18.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f278259c700 1 --2- 172.21.15.55:0/516521364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2770003a60 0x7f27840ad010 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f277400bfd0 tx=0x7f277401b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:18.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f277a7fc700 1 -- 172.21.15.55:0/516521364 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774014790 con 0x7f2770003a60 2023-09-30T01:59:18.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.968+0000 7f27888c8700 1 -- 172.21.15.55:0/516521364 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2784132350 con 0x7f2770003a60 2023-09-30T01:59:18.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.964+0000 7f277a7fc700 1 -- 172.21.15.55:0/516521364 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2774014930 con 0x7f2770003a60 2023-09-30T01:59:18.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.968+0000 7f277a7fc700 1 -- 172.21.15.55:0/516521364 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2774014cf0 con 0x7f2770003a60 2023-09-30T01:59:18.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.968+0000 7f27888c8700 1 -- 172.21.15.55:0/516521364 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27840ab940 con 0x7f2770003a60 2023-09-30T01:59:18.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.968+0000 7f27888c8700 1 -- 172.21.15.55:0/516521364 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278414fdc0 con 0x7f2770003a60 2023-09-30T01:59:18.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.968+0000 7f277a7fc700 1 -- 172.21.15.55:0/516521364 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f277401d610 con 0x7f2770003a60 2023-09-30T01:59:18.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.968+0000 7f277a7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:18.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.972+0000 7f277a7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:18.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.972+0000 7f277a7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:18.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.972+0000 7f277a7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:18.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.972+0000 7f277a7fc700 1 --2- 172.21.15.55:0/516521364 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f276408e8b0 0x7f2764090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:18.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.972+0000 7f277bfff700 1 --2- 172.21.15.55:0/516521364 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f276408e8b0 0x7f2764090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:18.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.972+0000 7f277a7fc700 1 -- 172.21.15.55:0/516521364 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f27740b6390 con 0x7f2770003a60 2023-09-30T01:59:18.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.972+0000 7f277bfff700 1 --2- 172.21.15.55:0/516521364 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f276408e8b0 0x7f2764090d60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f276c000ff0 tx=0x7f276c007040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:18.978 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:18.976+0000 7f277a7fc700 1 -- 172.21.15.55:0/516521364 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2774086dc0 con 0x7f2770003a60 2023-09-30T01:59:19.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.172+0000 7f27888c8700 1 -- 172.21.15.55:0/516521364 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2784135700 con 0x7f2770003a60 2023-09-30T01:59:19.176 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.172+0000 7f277a7fc700 1 -- 172.21.15.55:0/516521364 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f277408a3e0 con 0x7f2770003a60 2023-09-30T01:59:19.176 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:19.177 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:19.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.176+0000 7f27888c8700 10 mgrc shutdown 2023-09-30T01:59:19.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.176+0000 7f27888c8700 1 -- 172.21.15.55:0/516521364 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f276408e8b0 msgr2=0x7f2764090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:19.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.176+0000 7f27888c8700 1 --2- 172.21.15.55:0/516521364 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f276408e8b0 0x7f2764090d60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f276c000ff0 tx=0x7f276c007040 comp rx=0 tx=0).stop 2023-09-30T01:59:19.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.176+0000 7f27888c8700 1 -- 172.21.15.55:0/516521364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2770003a60 msgr2=0x7f27840ad010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:19.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.176+0000 7f27888c8700 1 --2- 172.21.15.55:0/516521364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2770003a60 0x7f27840ad010 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f277400bfd0 tx=0x7f277401b000 comp rx=0 tx=0).stop 2023-09-30T01:59:19.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.176+0000 7f27888c8700 1 -- 172.21.15.55:0/516521364 shutdown_connections 2023-09-30T01:59:19.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.176+0000 7f27888c8700 1 --2- 172.21.15.55:0/516521364 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f27841506b0 0x7f27840ab260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:19.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.176+0000 7f27888c8700 1 --2- 172.21.15.55:0/516521364 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2784131f20 0x7f2784150170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:19.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.176+0000 7f27888c8700 1 --2- 172.21.15.55:0/516521364 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f276408e8b0 0x7f2764090d60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:19.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.176+0000 7f27888c8700 1 --2- 172.21.15.55:0/516521364 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2770003a60 0x7f27840ad010 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:19.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.176+0000 7f27888c8700 1 -- 172.21.15.55:0/516521364 >> 172.21.15.55:0/516521364 conn(0x7f2784062d90 msgr2=0x7f2784132e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:19.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.176+0000 7f27888c8700 1 -- 172.21.15.55:0/516521364 shutdown_connections 2023-09-30T01:59:19.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:19.176+0000 7f27888c8700 1 -- 172.21.15.55:0/516521364 wait complete. 2023-09-30T01:59:22.192 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:22.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d74067700 1 Processor -- start 2023-09-30T01:59:22.303 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d74067700 1 -- start start 2023-09-30T01:59:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d74067700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d6c06e210 0x7f6d6c0a5390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d74067700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d6c1320c0 0x7f6d6c132490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d74067700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d6c06e5e0 con 0x7f6d6c063e80 2023-09-30T01:59:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d74067700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d6c1329d0 con 0x7f6d6c06e210 2023-09-30T01:59:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d74067700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c06bf00 con 0x7f6d6c1320c0 2023-09-30T01:59:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d71e03700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d6c06e210 0x7f6d6c0a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:22.304 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d71e03700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f6d6c06e210 0x7f6d6c0a5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59736/0 (socket says 172.21.15.55:59736) 2023-09-30T01:59:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d71e03700 1 -- 172.21.15.55:0/2964202446 learned_addr learned my addr 172.21.15.55:0/2964202446 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d71602700 1 --2- 172.21.15.55:0/2964202446 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d6c1320c0 0x7f6d6c132490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d71e03700 1 -- 172.21.15.55:0/2964202446 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d6c1320c0 msgr2=0x7f6d6c132490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d71e03700 1 --2- 172.21.15.55:0/2964202446 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d6c1320c0 0x7f6d6c132490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d71e03700 1 -- 172.21.15.55:0/2964202446 >> v1:172.21.15.133:6789/0 conn(0x7f6d6c063e80 legacy=0x7f6d6c0a4530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:22.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d71e03700 1 -- 172.21.15.55:0/2964202446 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d6c06c1c0 con 0x7f6d6c06e210 2023-09-30T01:59:22.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d71e03700 1 --2- 172.21.15.55:0/2964202446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c06e210 0x7f6d6c0a5390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009f50 tx=0x7f6d64009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecaba702c018531f server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:22.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d70e01700 1 -- 172.21.15.55:0/2964202446 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d640092e0 con 0x7f6d6c06e210 2023-09-30T01:59:22.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d70e01700 1 -- 172.21.15.55:0/2964202446 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d6400b9c0 con 0x7f6d6c06e210 2023-09-30T01:59:22.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.300+0000 7f6d70e01700 1 -- 172.21.15.55:0/2964202446 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d6400bd80 con 0x7f6d6c06e210 2023-09-30T01:59:22.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 -- 172.21.15.55:0/2964202446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c06e210 msgr2=0x7f6d6c0a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:22.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 --2- 172.21.15.55:0/2964202446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c06e210 0x7f6d6c0a5390 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009f50 tx=0x7f6d64009840 comp rx=0 tx=0).stop 2023-09-30T01:59:22.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 -- 172.21.15.55:0/2964202446 shutdown_connections 2023-09-30T01:59:22.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 --2- 172.21.15.55:0/2964202446 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d6c1320c0 0x7f6d6c132490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:22.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 --2- 172.21.15.55:0/2964202446 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c06e210 0x7f6d6c0a5390 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:22.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 -- 172.21.15.55:0/2964202446 >> 172.21.15.55:0/2964202446 conn(0x7f6d6c0b2b80 msgr2=0x7f6d6c0b2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:22.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 -- 172.21.15.55:0/2964202446 shutdown_connections 2023-09-30T01:59:22.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 -- 172.21.15.55:0/2964202446 wait complete. 2023-09-30T01:59:22.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 Processor -- start 2023-09-30T01:59:22.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 -- start start 2023-09-30T01:59:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c063e80 0x7f6d6c140ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d6c06e210 0x7f6d6c14f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6c1320c0 0x7f6d6c14fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0aab30 con 0x7f6d6c063e80 2023-09-30T01:59:22.310 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c0a9c70 con 0x7f6d6c1320c0 2023-09-30T01:59:22.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d6c150210 con 0x7f6d6c06e210 2023-09-30T01:59:22.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d71602700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d6c06e210 0x7f6d6c14f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:22.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d71602700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d6c06e210 0x7f6d6c14f580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56376/0 (socket says 172.21.15.55:56376) 2023-09-30T01:59:22.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d71602700 1 -- 172.21.15.55:0/4234619420 learned_addr learned my addr 172.21.15.55:0/4234619420 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:22.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d71e03700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c063e80 0x7f6d6c140ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:22.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d72604700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6c1320c0 0x7f6d6c14fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:22.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d71602700 1 -- 172.21.15.55:0/4234619420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6c1320c0 msgr2=0x7f6d6c14fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:22.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d71602700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6c1320c0 0x7f6d6c14fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:22.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d71602700 1 -- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c063e80 msgr2=0x7f6d6c140ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:22.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d71602700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c063e80 0x7f6d6c140ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:22.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d71602700 1 -- 172.21.15.55:0/4234619420 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d64009ae0 con 0x7f6d6c06e210 2023-09-30T01:59:22.311 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d72604700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6c1320c0 0x7f6d6c14fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:59:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d71e03700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c063e80 0x7f6d6c140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:59:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d71602700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d6c06e210 0x7f6d6c14f580 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00e960 tx=0x7f6d5c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d61ffb700 1 -- 172.21.15.55:0/4234619420 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c013680 con 0x7f6d6c06e210 2023-09-30T01:59:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d61ffb700 1 -- 172.21.15.55:0/4234619420 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d5c0137e0 con 0x7f6d6c06e210 2023-09-30T01:59:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d74067700 1 -- 172.21.15.55:0/4234619420 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d6c0a78b0 con 0x7f6d6c06e210 2023-09-30T01:59:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.304+0000 7f6d61ffb700 1 -- 172.21.15.55:0/4234619420 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d5c013b80 con 0x7f6d6c06e210 2023-09-30T01:59:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.308+0000 7f6d74067700 1 -- 172.21.15.55:0/4234619420 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d6c0a6ce0 con 0x7f6d6c06e210 2023-09-30T01:59:22.312 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.308+0000 7f6d74067700 1 -- 172.21.15.55:0/4234619420 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d6c0b2460 con 0x7f6d6c06e210 2023-09-30T01:59:22.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.308+0000 7f6d61ffb700 1 -- 172.21.15.55:0/4234619420 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f6d5c00c430 con 0x7f6d6c06e210 2023-09-30T01:59:22.313 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.308+0000 7f6d61ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:22.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.312+0000 7f6d61ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:22.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.312+0000 7f6d61ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:22.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.312+0000 7f6d61ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:22.314 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.312+0000 7f6d61ffb700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f6d5008e8b0 0x7f6d50090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:22.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.312+0000 7f6d71e03700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f6d5008e8b0 0x7f6d50090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:22.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.312+0000 7f6d61ffb700 1 -- 172.21.15.55:0/4234619420 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f6d5c0b4990 con 0x7f6d6c06e210 2023-09-30T01:59:22.315 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.312+0000 7f6d71e03700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f6d5008e8b0 0x7f6d50090d60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009880 tx=0x7f6d6401a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:22.321 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.320+0000 7f6d61ffb700 1 -- 172.21.15.55:0/4234619420 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6d6c0b2460 con 0x7f6d6c06e210 2023-09-30T01:59:22.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.516+0000 7f6d74067700 1 -- 172.21.15.55:0/4234619420 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6d6c0b2460 con 0x7f6d6c06e210 2023-09-30T01:59:22.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.516+0000 7f6d61ffb700 1 -- 172.21.15.55:0/4234619420 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f6d5c021100 con 0x7f6d6c06e210 2023-09-30T01:59:22.520 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:22.520 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:22.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.520+0000 7f6d74067700 10 mgrc shutdown 2023-09-30T01:59:22.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.520+0000 7f6d74067700 1 -- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f6d5008e8b0 msgr2=0x7f6d50090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:22.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.520+0000 7f6d74067700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f6d5008e8b0 0x7f6d50090d60 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f6d64009880 tx=0x7f6d6401a000 comp rx=0 tx=0).stop 2023-09-30T01:59:22.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.520+0000 7f6d74067700 1 -- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d6c06e210 msgr2=0x7f6d6c14f580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:22.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.520+0000 7f6d74067700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d6c06e210 0x7f6d6c14f580 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6d5c00e960 tx=0x7f6d5c0091a0 comp rx=0 tx=0).stop 2023-09-30T01:59:22.524 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.520+0000 7f6d74067700 1 -- 172.21.15.55:0/4234619420 shutdown_connections 2023-09-30T01:59:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.520+0000 7f6d74067700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d6c1320c0 0x7f6d6c14fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.520+0000 7f6d74067700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f6d5008e8b0 0x7f6d50090d60 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.520+0000 7f6d74067700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d6c06e210 0x7f6d6c14f580 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.520+0000 7f6d74067700 1 --2- 172.21.15.55:0/4234619420 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d6c063e80 0x7f6d6c140ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.520+0000 7f6d74067700 1 -- 172.21.15.55:0/4234619420 >> 172.21.15.55:0/4234619420 conn(0x7f6d6c0b2b80 msgr2=0x7f6d6c06c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.520+0000 7f6d74067700 1 -- 172.21.15.55:0/4234619420 shutdown_connections 2023-09-30T01:59:22.525 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:22.520+0000 7f6d74067700 1 -- 172.21.15.55:0/4234619420 wait complete. 2023-09-30T01:59:25.543 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.652+0000 7f5d2ffff700 1 Processor -- start 2023-09-30T01:59:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.652+0000 7f5d2ffff700 1 -- start start 2023-09-30T01:59:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5d300a55c0 0x7f5d300a8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:25.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2ffff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d300a48b0 con 0x7f5d300a8dd0 2023-09-30T01:59:25.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2ffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d300676a0 con 0x7f5d300672d0 2023-09-30T01:59:25.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2ffff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d300a3780 con 0x7f5d300a55c0 2023-09-30T01:59:25.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2f7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f5d300a8dd0 0x7f5d3014aa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46072/0 (socket says 172.21.15.55:46072) 2023-09-30T01:59:25.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2f7fe700 1 -- 172.21.15.55:0/3928629406 learned_addr learned my addr 172.21.15.55:0/3928629406 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:59:25.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2e7fc700 1 --2- 172.21.15.55:0/3928629406 >> v2:172.21.15.133:3300/0 conn(0x7f5d300a55c0 0x7f5d300a8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:25.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2dffb700 1 -- 172.21.15.55:0/3928629406 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973366458 0 0) 0x7f5d300a48b0 con 0x7f5d300a8dd0 2023-09-30T01:59:25.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2dffb700 1 -- 172.21.15.55:0/3928629406 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5d1c003570 con 0x7f5d300a8dd0 2023-09-30T01:59:25.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2e7fc700 1 -- 172.21.15.55:0/3928629406 >> v1:172.21.15.133:6789/0 conn(0x7f5d300672d0 legacy=0x7f5d3013f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:25.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2e7fc700 1 -- 172.21.15.55:0/3928629406 >> v1:172.21.15.55:6789/0 conn(0x7f5d300a8dd0 legacy=0x7f5d3014aa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:25.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2e7fc700 1 -- 172.21.15.55:0/3928629406 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d300a3970 con 0x7f5d300a55c0 2023-09-30T01:59:25.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2e7fc700 1 --2- 172.21.15.55:0/3928629406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d300a55c0 0x7f5d300a8890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009e60 tx=0x7f5d20009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7e7d909f514f3699 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:25.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2dffb700 1 -- 172.21.15.55:0/3928629406 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d2000e070 con 0x7f5d300a55c0 2023-09-30T01:59:25.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2dffb700 1 -- 172.21.15.55:0/3928629406 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d2000bb60 con 0x7f5d300a55c0 2023-09-30T01:59:25.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2dffb700 1 -- 172.21.15.55:0/3928629406 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d20012430 con 0x7f5d300a55c0 2023-09-30T01:59:25.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2ffff700 1 -- 172.21.15.55:0/3928629406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d300a55c0 msgr2=0x7f5d300a8890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:25.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2ffff700 1 --2- 172.21.15.55:0/3928629406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d300a55c0 0x7f5d300a8890 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f5d20009e60 tx=0x7f5d20009780 comp rx=0 tx=0).stop 2023-09-30T01:59:25.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2ffff700 1 -- 172.21.15.55:0/3928629406 shutdown_connections 2023-09-30T01:59:25.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2ffff700 1 --2- 172.21.15.55:0/3928629406 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d300a55c0 0x7f5d300a8890 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:25.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2ffff700 1 -- 172.21.15.55:0/3928629406 >> 172.21.15.55:0/3928629406 conn(0x7f5d300635c0 msgr2=0x7f5d3006ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:25.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2ffff700 1 -- 172.21.15.55:0/3928629406 shutdown_connections 2023-09-30T01:59:25.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2ffff700 1 -- 172.21.15.55:0/3928629406 wait complete. 2023-09-30T01:59:25.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2ffff700 1 Processor -- start 2023-09-30T01:59:25.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.656+0000 7f5d2ffff700 1 -- start start 2023-09-30T01:59:25.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d300672d0 0x7f5d3006c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:25.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d300a55c0 0x7f5d30143ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:25.664 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2ffff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d300a8dd0 0x7f5d30153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:25.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2ffff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d300b76c0 con 0x7f5d300a55c0 2023-09-30T01:59:25.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d301537b0 con 0x7f5d300672d0 2023-09-30T01:59:25.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2ffff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d3006b610 con 0x7f5d300a8dd0 2023-09-30T01:59:25.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2e7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d300a55c0 0x7f5d30143ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:25.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2f7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d300a8dd0 0x7f5d30153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:25.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2f7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d300a8dd0 0x7f5d30153270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:56380/0 (socket says 172.21.15.55:56380) 2023-09-30T01:59:25.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2f7fe700 1 -- 172.21.15.55:0/2229620903 learned_addr learned my addr 172.21.15.55:0/2229620903 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:25.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2effd700 1 --2- 172.21.15.55:0/2229620903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d300672d0 0x7f5d3006c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:25.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2f7fe700 1 -- 172.21.15.55:0/2229620903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d300672d0 msgr2=0x7f5d3006c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:25.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2f7fe700 1 --2- 172.21.15.55:0/2229620903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d300672d0 0x7f5d3006c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:25.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2f7fe700 1 -- 172.21.15.55:0/2229620903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d300a55c0 msgr2=0x7f5d30143ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:25.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2f7fe700 1 --2- 172.21.15.55:0/2229620903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d300a55c0 0x7f5d30143ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:25.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2f7fe700 1 -- 172.21.15.55:0/2229620903 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d20009a20 con 0x7f5d300a8dd0 2023-09-30T01:59:25.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2e7fc700 1 --2- 172.21.15.55:0/2229620903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d300a55c0 0x7f5d30143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:59:25.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2f7fe700 1 --2- 172.21.15.55:0/2229620903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d300a8dd0 0x7f5d30153270 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c560 tx=0x7f5d28007d70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:25.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d26ffd700 1 -- 172.21.15.55:0/2229620903 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d28005b30 con 0x7f5d300a8dd0 2023-09-30T01:59:25.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d26ffd700 1 -- 172.21.15.55:0/2229620903 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d28005c90 con 0x7f5d300a8dd0 2023-09-30T01:59:25.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2ffff700 1 -- 172.21.15.55:0/2229620903 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d30153c80 con 0x7f5d300a8dd0 2023-09-30T01:59:25.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d26ffd700 1 -- 172.21.15.55:0/2229620903 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d280072e0 con 0x7f5d300a8dd0 2023-09-30T01:59:25.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2ffff700 1 -- 172.21.15.55:0/2229620903 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3006e770 con 0x7f5d300a8dd0 2023-09-30T01:59:25.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.660+0000 7f5d2ffff700 1 -- 172.21.15.55:0/2229620903 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d30064440 con 0x7f5d300a8dd0 2023-09-30T01:59:25.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.664+0000 7f5d26ffd700 1 -- 172.21.15.55:0/2229620903 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f5d2801b3b0 con 0x7f5d300a8dd0 2023-09-30T01:59:25.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.664+0000 7f5d26ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:25.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.664+0000 7f5d26ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:25.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.664+0000 7f5d26ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:25.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.664+0000 7f5d26ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:25.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.664+0000 7f5d26ffd700 1 --2- 172.21.15.55:0/2229620903 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5d1008e8b0 0x7f5d10090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:25.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.664+0000 7f5d26ffd700 1 -- 172.21.15.55:0/2229620903 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f5d280b3b10 con 0x7f5d300a8dd0 2023-09-30T01:59:25.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.664+0000 7f5d2effd700 1 --2- 172.21.15.55:0/2229620903 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5d1008e8b0 0x7f5d10090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:25.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.668+0000 7f5d2effd700 1 --2- 172.21.15.55:0/2229620903 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5d1008e8b0 0x7f5d10090d60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5d18003a80 tx=0x7f5d18007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:25.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.672+0000 7f5d26ffd700 1 -- 172.21.15.55:0/2229620903 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5d28049be0 con 0x7f5d300a8dd0 2023-09-30T01:59:25.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.868+0000 7f5d2ffff700 1 -- 172.21.15.55:0/2229620903 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5d300a3c10 con 0x7f5d300a8dd0 2023-09-30T01:59:25.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.872+0000 7f5d26ffd700 1 -- 172.21.15.55:0/2229620903 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f5d28017020 con 0x7f5d300a8dd0 2023-09-30T01:59:25.874 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:25.874 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:25.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.872+0000 7f5d2ffff700 10 mgrc shutdown 2023-09-30T01:59:25.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.872+0000 7f5d2ffff700 1 -- 172.21.15.55:0/2229620903 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5d1008e8b0 msgr2=0x7f5d10090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:25.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.872+0000 7f5d2ffff700 1 --2- 172.21.15.55:0/2229620903 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5d1008e8b0 0x7f5d10090d60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5d18003a80 tx=0x7f5d18007ec0 comp rx=0 tx=0).stop 2023-09-30T01:59:25.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.872+0000 7f5d2ffff700 1 -- 172.21.15.55:0/2229620903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d300a8dd0 msgr2=0x7f5d30153270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:25.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.872+0000 7f5d2ffff700 1 --2- 172.21.15.55:0/2229620903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d300a8dd0 0x7f5d30153270 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5d2800c560 tx=0x7f5d28007d70 comp rx=0 tx=0).stop 2023-09-30T01:59:25.876 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.872+0000 7f5d2ffff700 1 -- 172.21.15.55:0/2229620903 shutdown_connections 2023-09-30T01:59:25.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.872+0000 7f5d2ffff700 1 --2- 172.21.15.55:0/2229620903 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5d1008e8b0 0x7f5d10090d60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:25.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.872+0000 7f5d2ffff700 1 --2- 172.21.15.55:0/2229620903 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5d300a8dd0 0x7f5d30153270 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:25.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.872+0000 7f5d2ffff700 1 --2- 172.21.15.55:0/2229620903 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5d300a55c0 0x7f5d30143ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:25.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.872+0000 7f5d2ffff700 1 --2- 172.21.15.55:0/2229620903 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5d300672d0 0x7f5d3006c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:25.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.872+0000 7f5d2ffff700 1 -- 172.21.15.55:0/2229620903 >> 172.21.15.55:0/2229620903 conn(0x7f5d300635c0 msgr2=0x7f5d3013d310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:25.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.872+0000 7f5d2ffff700 1 -- 172.21.15.55:0/2229620903 shutdown_connections 2023-09-30T01:59:25.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:25.872+0000 7f5d2ffff700 1 -- 172.21.15.55:0/2229620903 wait complete. 2023-09-30T01:59:28.889 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:29.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.000+0000 7fbb58f0d700 1 Processor -- start 2023-09-30T01:59:29.005 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.000+0000 7fbb58f0d700 1 -- start start 2023-09-30T01:59:29.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb58f0d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb540a0d80 0x7fbb540a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:29.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb58f0d700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbb5413e6f0 0x7fbb540a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:29.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb58f0d700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb5409f480 con 0x7fbb540a1150 2023-09-30T01:59:29.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb58f0d700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb5409f740 con 0x7fbb5413e6f0 2023-09-30T01:59:29.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb58f0d700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5406e040 con 0x7fbb540a0d80 2023-09-30T01:59:29.006 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb537fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb540a0d80 0x7fbb540a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:29.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb4bfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbb540a1150 0x7fbb5413dfe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:46086/0 (socket says 172.21.15.55:46086) 2023-09-30T01:59:29.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb4bfff700 1 -- 172.21.15.55:0/3835874786 learned_addr learned my addr 172.21.15.55:0/3835874786 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:59:29.007 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb53fff700 1 --2- 172.21.15.55:0/3835874786 >> v2:172.21.15.133:3300/0 conn(0x7fbb5413e6f0 0x7fbb540a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:29.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb52ffd700 1 -- 172.21.15.55:0/3835874786 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829015994 0 0) 0x7fbb5409f480 con 0x7fbb540a1150 2023-09-30T01:59:29.008 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb52ffd700 1 -- 172.21.15.55:0/3835874786 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb40003570 con 0x7fbb540a1150 2023-09-30T01:59:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb537fe700 1 -- 172.21.15.55:0/3835874786 >> v2:172.21.15.133:3300/0 conn(0x7fbb5413e6f0 msgr2=0x7fbb540a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb537fe700 1 --2- 172.21.15.55:0/3835874786 >> v2:172.21.15.133:3300/0 conn(0x7fbb5413e6f0 0x7fbb540a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb537fe700 1 -- 172.21.15.55:0/3835874786 >> v1:172.21.15.55:6789/0 conn(0x7fbb540a1150 legacy=0x7fbb5413dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb537fe700 1 -- 172.21.15.55:0/3835874786 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb540a2240 con 0x7fbb540a0d80 2023-09-30T01:59:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb53fff700 1 --2- 172.21.15.55:0/3835874786 >> v2:172.21.15.133:3300/0 conn(0x7fbb5413e6f0 0x7fbb540a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:59:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb537fe700 1 --2- 172.21.15.55:0/3835874786 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb540a0d80 0x7fbb540a4a90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb440098e0 tx=0x7fbb440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a6e3e75edd6c9a6 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb52ffd700 1 -- 172.21.15.55:0/3835874786 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4400b640 con 0x7fbb540a0d80 2023-09-30T01:59:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb52ffd700 1 -- 172.21.15.55:0/3835874786 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4400b7a0 con 0x7fbb540a0d80 2023-09-30T01:59:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb52ffd700 1 -- 172.21.15.55:0/3835874786 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4400bb40 con 0x7fbb540a0d80 2023-09-30T01:59:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb58f0d700 1 -- 172.21.15.55:0/3835874786 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb540a0d80 msgr2=0x7fbb540a4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:29.009 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb58f0d700 1 --2- 172.21.15.55:0/3835874786 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb540a0d80 0x7fbb540a4a90 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fbb440098e0 tx=0x7fbb440091a0 comp rx=0 tx=0).stop 2023-09-30T01:59:29.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb58f0d700 1 -- 172.21.15.55:0/3835874786 shutdown_connections 2023-09-30T01:59:29.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb58f0d700 1 --2- 172.21.15.55:0/3835874786 >> v2:172.21.15.133:3300/0 conn(0x7fbb5413e6f0 0x7fbb540a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:29.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb58f0d700 1 --2- 172.21.15.55:0/3835874786 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb540a0d80 0x7fbb540a4a90 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:29.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb58f0d700 1 -- 172.21.15.55:0/3835874786 >> 172.21.15.55:0/3835874786 conn(0x7fbb540b23d0 msgr2=0x7fbb540b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:29.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb58f0d700 1 -- 172.21.15.55:0/3835874786 shutdown_connections 2023-09-30T01:59:29.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.004+0000 7fbb58f0d700 1 -- 172.21.15.55:0/3835874786 wait complete. 2023-09-30T01:59:29.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb58f0d700 1 Processor -- start 2023-09-30T01:59:29.010 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb58f0d700 1 -- start start 2023-09-30T01:59:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb58f0d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb540a1150 0x7fbb5409b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb58f0d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5413e6f0 0x7fbb541428e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:29.011 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb58f0d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb541512e0 0x7fbb5413ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:29.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb58f0d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb5409ba10 con 0x7fbb5413e6f0 2023-09-30T01:59:29.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb58f0d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54150e50 con 0x7fbb541512e0 2023-09-30T01:59:29.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb58f0d700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb54151cb0 con 0x7fbb540a1150 2023-09-30T01:59:29.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb4bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5413e6f0 0x7fbb541428e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:29.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb4bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5413e6f0 0x7fbb541428e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:59774/0 (socket says 172.21.15.55:59774) 2023-09-30T01:59:29.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb537fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb540a1150 0x7fbb5409b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:29.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb4bfff700 1 -- 172.21.15.55:0/1187371288 learned_addr learned my addr 172.21.15.55:0/1187371288 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:29.012 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb53fff700 1 --2- 172.21.15.55:0/1187371288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb541512e0 0x7fbb5413ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:29.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb537fe700 1 -- 172.21.15.55:0/1187371288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb541512e0 msgr2=0x7fbb5413ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:29.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb537fe700 1 --2- 172.21.15.55:0/1187371288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb541512e0 0x7fbb5413ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:29.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb537fe700 1 -- 172.21.15.55:0/1187371288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5413e6f0 msgr2=0x7fbb541428e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:29.013 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb537fe700 1 --2- 172.21.15.55:0/1187371288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5413e6f0 0x7fbb541428e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb537fe700 1 -- 172.21.15.55:0/1187371288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb44009420 con 0x7fbb540a1150 2023-09-30T01:59:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb4bfff700 1 --2- 172.21.15.55:0/1187371288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5413e6f0 0x7fbb541428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:59:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb537fe700 1 --2- 172.21.15.55:0/1187371288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb540a1150 0x7fbb5409b4d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb44016000 tx=0x7fbb44017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb4b7fe700 1 -- 172.21.15.55:0/1187371288 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb4401bb30 con 0x7fbb540a1150 2023-09-30T01:59:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb4b7fe700 1 -- 172.21.15.55:0/1187371288 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb4401bcb0 con 0x7fbb540a1150 2023-09-30T01:59:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb58f0d700 1 -- 172.21.15.55:0/1187371288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb54098810 con 0x7fbb540a1150 2023-09-30T01:59:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb4b7fe700 1 -- 172.21.15.55:0/1187371288 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb44011670 con 0x7fbb540a1150 2023-09-30T01:59:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.008+0000 7fbb58f0d700 1 -- 172.21.15.55:0/1187371288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb54142e20 con 0x7fbb540a1150 2023-09-30T01:59:29.014 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.012+0000 7fbb58f0d700 1 -- 172.21.15.55:0/1187371288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb54064440 con 0x7fbb540a1150 2023-09-30T01:59:29.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.012+0000 7fbb4b7fe700 1 -- 172.21.15.55:0/1187371288 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fbb44030080 con 0x7fbb540a1150 2023-09-30T01:59:29.016 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.012+0000 7fbb4b7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.012+0000 7fbb4b7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.012+0000 7fbb4b7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.012+0000 7fbb4b7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.012+0000 7fbb4b7fe700 1 --2- 172.21.15.55:0/1187371288 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbb3408e8e0 0x7fbb34090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.016+0000 7fbb4bfff700 1 --2- 172.21.15.55:0/1187371288 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbb3408e8e0 0x7fbb34090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:29.017 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.016+0000 7fbb4b7fe700 1 -- 172.21.15.55:0/1187371288 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fbb440b54d0 con 0x7fbb540a1150 2023-09-30T01:59:29.018 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.016+0000 7fbb4bfff700 1 --2- 172.21.15.55:0/1187371288 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbb3408e8e0 0x7fbb34090d90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbb5413ba30 tx=0x7fbb3c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:29.023 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.020+0000 7fbb4b7fe700 1 -- 172.21.15.55:0/1187371288 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbb44085f00 con 0x7fbb540a1150 2023-09-30T01:59:29.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.220+0000 7fbb58f0d700 1 -- 172.21.15.55:0/1187371288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbb540680b0 con 0x7fbb540a1150 2023-09-30T01:59:29.225 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.220+0000 7fbb4b7fe700 1 -- 172.21.15.55:0/1187371288 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fbb44089520 con 0x7fbb540a1150 2023-09-30T01:59:29.226 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:29.226 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:29.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.224+0000 7fbb58f0d700 10 mgrc shutdown 2023-09-30T01:59:29.227 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.224+0000 7fbb58f0d700 1 -- 172.21.15.55:0/1187371288 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbb3408e8e0 msgr2=0x7fbb34090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:29.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.224+0000 7fbb58f0d700 1 --2- 172.21.15.55:0/1187371288 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbb3408e8e0 0x7fbb34090d90 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fbb5413ba30 tx=0x7fbb3c009040 comp rx=0 tx=0).stop 2023-09-30T01:59:29.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.224+0000 7fbb58f0d700 1 -- 172.21.15.55:0/1187371288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb540a1150 msgr2=0x7fbb5409b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:29.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.224+0000 7fbb58f0d700 1 --2- 172.21.15.55:0/1187371288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb540a1150 0x7fbb5409b4d0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fbb44016000 tx=0x7fbb44017000 comp rx=0 tx=0).stop 2023-09-30T01:59:29.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.224+0000 7fbb58f0d700 1 -- 172.21.15.55:0/1187371288 shutdown_connections 2023-09-30T01:59:29.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.224+0000 7fbb58f0d700 1 --2- 172.21.15.55:0/1187371288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbb541512e0 0x7fbb5413ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:29.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.224+0000 7fbb58f0d700 1 --2- 172.21.15.55:0/1187371288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbb5413e6f0 0x7fbb541428e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:29.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.224+0000 7fbb58f0d700 1 --2- 172.21.15.55:0/1187371288 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbb3408e8e0 0x7fbb34090d90 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:29.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.224+0000 7fbb58f0d700 1 --2- 172.21.15.55:0/1187371288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbb540a1150 0x7fbb5409b4d0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:29.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.224+0000 7fbb58f0d700 1 -- 172.21.15.55:0/1187371288 >> 172.21.15.55:0/1187371288 conn(0x7fbb540b23d0 msgr2=0x7fbb5406ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:29.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.224+0000 7fbb58f0d700 1 -- 172.21.15.55:0/1187371288 shutdown_connections 2023-09-30T01:59:29.228 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:29.224+0000 7fbb58f0d700 1 -- 172.21.15.55:0/1187371288 wait complete. 2023-09-30T01:59:32.239 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:32.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.348+0000 7f2f43fff700 1 Processor -- start 2023-09-30T01:59:32.353 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.348+0000 7f2f43fff700 1 -- start start 2023-09-30T01:59:32.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f43fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f44135fe0 0x7f2f4406d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:32.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f43fff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f4406eb00 con 0x7f2f44143360 2023-09-30T01:59:32.355 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f43fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f44143f90 con 0x7f2f4406e6c0 2023-09-30T01:59:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f43fff700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f441363b0 con 0x7f2f44135fe0 2023-09-30T01:59:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f42ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2f44135fe0 0x7f2f4406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f437fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f2f44143360 0x7f2f441437a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47318/0 (socket says 172.21.15.55:47318) 2023-09-30T01:59:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f437fe700 1 -- 172.21.15.55:0/2089894913 learned_addr learned my addr 172.21.15.55:0/2089894913 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:59:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f42ffd700 1 -- 172.21.15.55:0/2089894913 >> v1:172.21.15.133:6789/0 conn(0x7f2f4406e6c0 legacy=0x7f2f4406ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f42ffd700 1 -- 172.21.15.55:0/2089894913 >> v1:172.21.15.55:6789/0 conn(0x7f2f44143360 legacy=0x7f2f441437a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:32.356 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f42ffd700 1 -- 172.21.15.55:0/2089894913 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f441364f0 con 0x7f2f44135fe0 2023-09-30T01:59:32.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f42ffd700 1 --2- 172.21.15.55:0/2089894913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f44135fe0 0x7f2f4406d380 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009e90 tx=0x7f2f3c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c7c9870fe0a1b5 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:32.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f41ffb700 1 -- 172.21.15.55:0/2089894913 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c00e070 con 0x7f2f44135fe0 2023-09-30T01:59:32.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f41ffb700 1 -- 172.21.15.55:0/2089894913 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c00bbf0 con 0x7f2f44135fe0 2023-09-30T01:59:32.357 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f41ffb700 1 -- 172.21.15.55:0/2089894913 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c012430 con 0x7f2f44135fe0 2023-09-30T01:59:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f43fff700 1 -- 172.21.15.55:0/2089894913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f44135fe0 msgr2=0x7f2f4406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f43fff700 1 --2- 172.21.15.55:0/2089894913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f44135fe0 0x7f2f4406d380 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c009e90 tx=0x7f2f3c009780 comp rx=0 tx=0).stop 2023-09-30T01:59:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f43fff700 1 -- 172.21.15.55:0/2089894913 shutdown_connections 2023-09-30T01:59:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f43fff700 1 --2- 172.21.15.55:0/2089894913 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f44135fe0 0x7f2f4406d380 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f43fff700 1 -- 172.21.15.55:0/2089894913 >> 172.21.15.55:0/2089894913 conn(0x7f2f4406a7b0 msgr2=0x7f2f440a53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f43fff700 1 -- 172.21.15.55:0/2089894913 shutdown_connections 2023-09-30T01:59:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.352+0000 7f2f43fff700 1 -- 172.21.15.55:0/2089894913 wait complete. 2023-09-30T01:59:32.361 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f43fff700 1 Processor -- start 2023-09-30T01:59:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f43fff700 1 -- start start 2023-09-30T01:59:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f43fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f4406e6c0 0x7f2f4409d140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f43fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f44135fe0 0x7f2f440ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f43fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f44143360 0x7f2f4414a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f43fff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f440ad2e0 con 0x7f2f4406e6c0 2023-09-30T01:59:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f43fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f440ac0f0 con 0x7f2f44143360 2023-09-30T01:59:32.362 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f43fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f44147910 con 0x7f2f44135fe0 2023-09-30T01:59:32.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f42ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f4406e6c0 0x7f2f4409d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:32.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f42ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f4406e6c0 0x7f2f4409d140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:39156/0 (socket says 172.21.15.55:39156) 2023-09-30T01:59:32.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f42ffd700 1 -- 172.21.15.55:0/3917675837 learned_addr learned my addr 172.21.15.55:0/3917675837 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:32.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f427fc700 1 --2- 172.21.15.55:0/3917675837 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f44135fe0 0x7f2f440ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:32.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f437fe700 1 --2- 172.21.15.55:0/3917675837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f44143360 0x7f2f4414a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:32.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f42ffd700 1 -- 172.21.15.55:0/3917675837 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f44135fe0 msgr2=0x7f2f440ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:32.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f42ffd700 1 --2- 172.21.15.55:0/3917675837 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f44135fe0 0x7f2f440ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:32.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f42ffd700 1 -- 172.21.15.55:0/3917675837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f44143360 msgr2=0x7f2f4414a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:32.363 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f42ffd700 1 --2- 172.21.15.55:0/3917675837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f44143360 0x7f2f4414a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:32.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f42ffd700 1 -- 172.21.15.55:0/3917675837 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f3c009a20 con 0x7f2f4406e6c0 2023-09-30T01:59:32.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f42ffd700 1 --2- 172.21.15.55:0/3917675837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f4406e6c0 0x7f2f4409d140 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00b6c0 tx=0x7f2f3c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:32.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f3affd700 1 -- 172.21.15.55:0/3917675837 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c012430 con 0x7f2f4406e6c0 2023-09-30T01:59:32.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f3affd700 1 -- 172.21.15.55:0/3917675837 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f3c012e60 con 0x7f2f4406e6c0 2023-09-30T01:59:32.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f3affd700 1 -- 172.21.15.55:0/3917675837 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f3c027680 con 0x7f2f4406e6c0 2023-09-30T01:59:32.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f43fff700 1 -- 172.21.15.55:0/3917675837 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f440aba90 con 0x7f2f4406e6c0 2023-09-30T01:59:32.364 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.356+0000 7f2f43fff700 1 -- 172.21.15.55:0/3917675837 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f4409d710 con 0x7f2f4406e6c0 2023-09-30T01:59:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.360+0000 7f2f43fff700 1 -- 172.21.15.55:0/3917675837 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f4409d900 con 0x7f2f4406e6c0 2023-09-30T01:59:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.360+0000 7f2f3affd700 1 -- 172.21.15.55:0/3917675837 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f2f3c024070 con 0x7f2f4406e6c0 2023-09-30T01:59:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.360+0000 7f2f3affd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.360+0000 7f2f3affd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:32.365 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.360+0000 7f2f3affd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.360+0000 7f2f3affd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.360+0000 7f2f3affd700 1 --2- 172.21.15.55:0/3917675837 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2f2408e830 0x7f2f24090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.360+0000 7f2f427fc700 1 --2- 172.21.15.55:0/3917675837 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2f2408e830 0x7f2f24090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:32.366 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.360+0000 7f2f3affd700 1 -- 172.21.15.55:0/3917675837 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f2f3c0b6f10 con 0x7f2f4406e6c0 2023-09-30T01:59:32.367 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.364+0000 7f2f427fc700 1 --2- 172.21.15.55:0/3917675837 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2f2408e830 0x7f2f24090ce0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2f44143ea0 tx=0x7f2f2c000bc0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:32.372 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.368+0000 7f2f3affd700 1 -- 172.21.15.55:0/3917675837 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2f3c087940 con 0x7f2f4406e6c0 2023-09-30T01:59:32.563 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.559+0000 7f2f43fff700 1 -- 172.21.15.55:0/3917675837 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2f44064440 con 0x7f2f4406e6c0 2023-09-30T01:59:32.564 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.559+0000 7f2f3affd700 1 -- 172.21.15.55:0/3917675837 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f2f3c02c020 con 0x7f2f4406e6c0 2023-09-30T01:59:32.565 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:32.565 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:32.567 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.563+0000 7f2f43fff700 10 mgrc shutdown 2023-09-30T01:59:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.563+0000 7f2f43fff700 1 -- 172.21.15.55:0/3917675837 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2f2408e830 msgr2=0x7f2f24090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.563+0000 7f2f43fff700 1 --2- 172.21.15.55:0/3917675837 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2f2408e830 0x7f2f24090ce0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2f44143ea0 tx=0x7f2f2c000bc0 comp rx=0 tx=0).stop 2023-09-30T01:59:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.563+0000 7f2f43fff700 1 -- 172.21.15.55:0/3917675837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f4406e6c0 msgr2=0x7f2f4409d140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.563+0000 7f2f43fff700 1 --2- 172.21.15.55:0/3917675837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f4406e6c0 0x7f2f4409d140 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f2f3c00b6c0 tx=0x7f2f3c019000 comp rx=0 tx=0).stop 2023-09-30T01:59:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.563+0000 7f2f43fff700 1 -- 172.21.15.55:0/3917675837 shutdown_connections 2023-09-30T01:59:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.563+0000 7f2f43fff700 1 --2- 172.21.15.55:0/3917675837 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f2f44143360 0x7f2f4414a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.563+0000 7f2f43fff700 1 --2- 172.21.15.55:0/3917675837 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f2f2408e830 0x7f2f24090ce0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.563+0000 7f2f43fff700 1 --2- 172.21.15.55:0/3917675837 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2f44135fe0 0x7f2f440ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.563+0000 7f2f43fff700 1 --2- 172.21.15.55:0/3917675837 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2f4406e6c0 0x7f2f4409d140 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.563+0000 7f2f43fff700 1 -- 172.21.15.55:0/3917675837 >> 172.21.15.55:0/3917675837 conn(0x7f2f4406a7b0 msgr2=0x7f2f4406b330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:32.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.563+0000 7f2f43fff700 1 -- 172.21.15.55:0/3917675837 shutdown_connections 2023-09-30T01:59:32.569 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:32.563+0000 7f2f43fff700 1 -- 172.21.15.55:0/3917675837 wait complete. 2023-09-30T01:59:35.579 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:35.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.687+0000 7f6d37fff700 1 Processor -- start 2023-09-30T01:59:35.692 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.687+0000 7f6d37fff700 1 -- start start 2023-09-30T01:59:35.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.687+0000 7f6d37fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d380a4d60 0x7f6d380aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:35.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.687+0000 7f6d37fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f6d3813a750 0x7f6d3809f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:35.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.687+0000 7f6d37fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d380af120 con 0x7f6d380a4990 2023-09-30T01:59:35.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.687+0000 7f6d37fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d3809f8b0 con 0x7f6d3813a750 2023-09-30T01:59:35.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.687+0000 7f6d37fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d380af5b0 con 0x7f6d380a4d60 2023-09-30T01:59:35.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.687+0000 7f6d367fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d380a4d60 0x7f6d380aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:35.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.687+0000 7f6d367fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d380a4d60 0x7f6d380aeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:42912/0 (socket says 172.21.15.55:42912) 2023-09-30T01:59:35.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.687+0000 7f6d367fc700 1 -- 172.21.15.55:0/959946579 learned_addr learned my addr 172.21.15.55:0/959946579 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:35.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.687+0000 7f6d377fe700 1 --2- 172.21.15.55:0/959946579 >> v2:172.21.15.133:3300/0 conn(0x7f6d3813a750 0x7f6d3809f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:35.694 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.687+0000 7f6d367fc700 1 -- 172.21.15.55:0/959946579 >> v2:172.21.15.133:3300/0 conn(0x7f6d3813a750 msgr2=0x7f6d3809f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:35.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.687+0000 7f6d367fc700 1 --2- 172.21.15.55:0/959946579 >> v2:172.21.15.133:3300/0 conn(0x7f6d3813a750 0x7f6d3809f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:35.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.687+0000 7f6d367fc700 1 -- 172.21.15.55:0/959946579 >> v1:172.21.15.133:6789/0 conn(0x7f6d380a4990 legacy=0x7f6d380a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:35.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d367fc700 1 -- 172.21.15.55:0/959946579 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d3809fb10 con 0x7f6d380a4d60 2023-09-30T01:59:35.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d377fe700 1 --2- 172.21.15.55:0/959946579 >> v2:172.21.15.133:3300/0 conn(0x7f6d3813a750 0x7f6d3809f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:59:35.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d367fc700 1 --2- 172.21.15.55:0/959946579 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d380a4d60 0x7f6d380aeb90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009f20 tx=0x7f6d28009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7171779bdb0323b4 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:35.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d35ffb700 1 -- 172.21.15.55:0/959946579 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d2800e070 con 0x7f6d380a4d60 2023-09-30T01:59:35.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d35ffb700 1 -- 172.21.15.55:0/959946579 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d2800ba40 con 0x7f6d380a4d60 2023-09-30T01:59:35.695 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d35ffb700 1 -- 172.21.15.55:0/959946579 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d280092e0 con 0x7f6d380a4d60 2023-09-30T01:59:35.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 -- 172.21.15.55:0/959946579 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d380a4d60 msgr2=0x7f6d380aeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:35.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 --2- 172.21.15.55:0/959946579 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d380a4d60 0x7f6d380aeb90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f6d28009f20 tx=0x7f6d28009840 comp rx=0 tx=0).stop 2023-09-30T01:59:35.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 -- 172.21.15.55:0/959946579 shutdown_connections 2023-09-30T01:59:35.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 --2- 172.21.15.55:0/959946579 >> v2:172.21.15.133:3300/0 conn(0x7f6d3813a750 0x7f6d3809f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:35.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 --2- 172.21.15.55:0/959946579 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d380a4d60 0x7f6d380aeb90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:35.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 -- 172.21.15.55:0/959946579 >> 172.21.15.55:0/959946579 conn(0x7f6d380b23d0 msgr2=0x7f6d380b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:35.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 -- 172.21.15.55:0/959946579 shutdown_connections 2023-09-30T01:59:35.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 -- 172.21.15.55:0/959946579 wait complete. 2023-09-30T01:59:35.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 Processor -- start 2023-09-30T01:59:35.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 -- start start 2023-09-30T01:59:35.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d380a4990 0x7f6d38098010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:35.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d380a4d60 0x7f6d38096270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:35.698 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d3813a750 0x7f6d380967b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d380978e0 con 0x7f6d380a4d60 2023-09-30T01:59:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d38095fb0 con 0x7f6d380a4990 2023-09-30T01:59:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d37fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d3814a490 con 0x7f6d3813a750 2023-09-30T01:59:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d377fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d3813a750 0x7f6d380967b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d377fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d3813a750 0x7f6d380967b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:42924/0 (socket says 172.21.15.55:42924) 2023-09-30T01:59:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d377fe700 1 -- 172.21.15.55:0/3058715552 learned_addr learned my addr 172.21.15.55:0/3058715552 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d367fc700 1 --2- 172.21.15.55:0/3058715552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d380a4d60 0x7f6d38096270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d36ffd700 1 --2- 172.21.15.55:0/3058715552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d380a4990 0x7f6d38098010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d377fe700 1 -- 172.21.15.55:0/3058715552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d380a4990 msgr2=0x7f6d38098010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d377fe700 1 --2- 172.21.15.55:0/3058715552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d380a4990 0x7f6d38098010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:35.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.691+0000 7f6d377fe700 1 -- 172.21.15.55:0/3058715552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d380a4d60 msgr2=0x7f6d38096270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:35.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.695+0000 7f6d377fe700 1 --2- 172.21.15.55:0/3058715552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d380a4d60 0x7f6d38096270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:35.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.695+0000 7f6d377fe700 1 -- 172.21.15.55:0/3058715552 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d28009ae0 con 0x7f6d3813a750 2023-09-30T01:59:35.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.695+0000 7f6d377fe700 1 --2- 172.21.15.55:0/3058715552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d3813a750 0x7f6d380967b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000e870 tx=0x7f6d30008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:35.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.695+0000 7f6d1effd700 1 -- 172.21.15.55:0/3058715552 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d3000c070 con 0x7f6d3813a750 2023-09-30T01:59:35.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.695+0000 7f6d1effd700 1 -- 172.21.15.55:0/3058715552 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d30013410 con 0x7f6d3813a750 2023-09-30T01:59:35.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.695+0000 7f6d1effd700 1 -- 172.21.15.55:0/3058715552 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d300137b0 con 0x7f6d3813a750 2023-09-30T01:59:35.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.695+0000 7f6d37fff700 1 -- 172.21.15.55:0/3058715552 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d38098550 con 0x7f6d3813a750 2023-09-30T01:59:35.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.695+0000 7f6d37fff700 1 -- 172.21.15.55:0/3058715552 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d3806da60 con 0x7f6d3813a750 2023-09-30T01:59:35.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.695+0000 7f6d37fff700 1 -- 172.21.15.55:0/3058715552 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d380987d0 con 0x7f6d3813a750 2023-09-30T01:59:35.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.699+0000 7f6d1effd700 1 -- 172.21.15.55:0/3058715552 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f6d30013b60 con 0x7f6d3813a750 2023-09-30T01:59:35.702 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.699+0000 7f6d1effd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:35.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.699+0000 7f6d1effd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:35.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.699+0000 7f6d1effd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:35.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.699+0000 7f6d1effd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:35.703 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.699+0000 7f6d1effd700 1 --2- 172.21.15.55:0/3058715552 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f6d2408e8b0 0x7f6d24090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:35.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.699+0000 7f6d36ffd700 1 --2- 172.21.15.55:0/3058715552 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f6d2408e8b0 0x7f6d24090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:35.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.699+0000 7f6d1effd700 1 -- 172.21.15.55:0/3058715552 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f6d300b4ba0 con 0x7f6d3813a750 2023-09-30T01:59:35.704 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.699+0000 7f6d36ffd700 1 --2- 172.21.15.55:0/3058715552 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f6d2408e8b0 0x7f6d24090d60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0039e0 tx=0x7f6d2c007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:35.705 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.703+0000 7f6d1effd700 1 -- 172.21.15.55:0/3058715552 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f6d30085530 con 0x7f6d3813a750 2023-09-30T01:59:35.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d37fff700 1 -- 172.21.15.55:0/3058715552 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f6d38064440 con 0x7f6d3813a750 2023-09-30T01:59:35.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d1effd700 1 -- 172.21.15.55:0/3058715552 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f6d30017100 con 0x7f6d3813a750 2023-09-30T01:59:35.898 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:35.898 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d37fff700 10 mgrc shutdown 2023-09-30T01:59:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d37fff700 1 -- 172.21.15.55:0/3058715552 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f6d2408e8b0 msgr2=0x7f6d24090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d37fff700 1 --2- 172.21.15.55:0/3058715552 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f6d2408e8b0 0x7f6d24090d60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f6d2c0039e0 tx=0x7f6d2c007ec0 comp rx=0 tx=0).stop 2023-09-30T01:59:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d37fff700 1 -- 172.21.15.55:0/3058715552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d3813a750 msgr2=0x7f6d380967b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d37fff700 1 --2- 172.21.15.55:0/3058715552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d3813a750 0x7f6d380967b0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f6d3000e870 tx=0x7f6d30008040 comp rx=0 tx=0).stop 2023-09-30T01:59:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d37fff700 1 -- 172.21.15.55:0/3058715552 shutdown_connections 2023-09-30T01:59:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d37fff700 1 --2- 172.21.15.55:0/3058715552 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f6d2408e8b0 0x7f6d24090d60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d37fff700 1 --2- 172.21.15.55:0/3058715552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f6d3813a750 0x7f6d380967b0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d37fff700 1 --2- 172.21.15.55:0/3058715552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f6d380a4d60 0x7f6d38096270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:35.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d37fff700 1 --2- 172.21.15.55:0/3058715552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f6d380a4990 0x7f6d38098010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:35.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d37fff700 1 -- 172.21.15.55:0/3058715552 >> 172.21.15.55:0/3058715552 conn(0x7f6d380b23d0 msgr2=0x7f6d380b10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:35.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d37fff700 1 -- 172.21.15.55:0/3058715552 shutdown_connections 2023-09-30T01:59:35.902 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:35.895+0000 7f6d37fff700 1 -- 172.21.15.55:0/3058715552 wait complete. 2023-09-30T01:59:38.913 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:39.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.019+0000 7f4f4148f700 1 Processor -- start 2023-09-30T01:59:39.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.019+0000 7f4f4148f700 1 -- start start 2023-09-30T01:59:39.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f4148f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f4f3c068480 0x7f4f3c13ee30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:39.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f4148f700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4f3c13f370 0x7f4f3c13da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:39.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f4148f700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3c13f7d0 con 0x7f4f3c0680b0 2023-09-30T01:59:39.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f4148f700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c13e720 con 0x7f4f3c13f370 2023-09-30T01:59:39.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f4148f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3c13e9e0 con 0x7f4f3c068480 2023-09-30T01:59:39.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f3b7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f4f3c13f370 0x7f4f3c13da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:39.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f3affd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f4f3c0680b0 0x7f4f3c0a6b80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:47322/0 (socket says 172.21.15.55:47322) 2023-09-30T01:59:39.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f3affd700 1 -- 172.21.15.55:0/822576035 learned_addr learned my addr 172.21.15.55:0/822576035 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:59:39.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f3a7fc700 1 --2- 172.21.15.55:0/822576035 >> v2:172.21.15.133:3300/0 conn(0x7f4f3c068480 0x7f4f3c13ee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:39.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f39ffb700 1 -- 172.21.15.55:0/822576035 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111682248 0 0) 0x7f4f3c13f7d0 con 0x7f4f3c0680b0 2023-09-30T01:59:39.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f39ffb700 1 -- 172.21.15.55:0/822576035 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f24003570 con 0x7f4f3c0680b0 2023-09-30T01:59:39.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f3b7fe700 1 -- 172.21.15.55:0/822576035 >> v2:172.21.15.133:3300/0 conn(0x7f4f3c068480 msgr2=0x7f4f3c13ee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:39.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f3b7fe700 1 --2- 172.21.15.55:0/822576035 >> v2:172.21.15.133:3300/0 conn(0x7f4f3c068480 0x7f4f3c13ee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:39.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f3b7fe700 1 -- 172.21.15.55:0/822576035 >> v1:172.21.15.55:6789/0 conn(0x7f4f3c0680b0 legacy=0x7f4f3c0a6b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:39.027 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f39ffb700 1 -- 172.21.15.55:0/822576035 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4173983034 0 0) 0x7f4f24003570 con 0x7f4f3c0680b0 2023-09-30T01:59:39.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f3b7fe700 1 -- 172.21.15.55:0/822576035 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f3c06e090 con 0x7f4f3c13f370 2023-09-30T01:59:39.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f3a7fc700 1 --2- 172.21.15.55:0/822576035 >> v2:172.21.15.133:3300/0 conn(0x7f4f3c068480 0x7f4f3c13ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:59:39.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f3b7fe700 1 --2- 172.21.15.55:0/822576035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f3c13f370 0x7f4f3c13da90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c06eab0 tx=0x7f4f34009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26078012d4b52727 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:39.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f39ffb700 1 -- 172.21.15.55:0/822576035 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3400e070 con 0x7f4f3c13f370 2023-09-30T01:59:39.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f39ffb700 1 -- 172.21.15.55:0/822576035 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3400b7a0 con 0x7f4f3c13f370 2023-09-30T01:59:39.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f39ffb700 1 -- 172.21.15.55:0/822576035 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c001470 con 0x7f4f3c13f370 2023-09-30T01:59:39.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f4148f700 1 -- 172.21.15.55:0/822576035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f3c13f370 msgr2=0x7f4f3c13da90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:39.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f4148f700 1 --2- 172.21.15.55:0/822576035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f3c13f370 0x7f4f3c13da90 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c06eab0 tx=0x7f4f34009780 comp rx=0 tx=0).stop 2023-09-30T01:59:39.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f4148f700 1 -- 172.21.15.55:0/822576035 shutdown_connections 2023-09-30T01:59:39.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f4148f700 1 --2- 172.21.15.55:0/822576035 >> v2:172.21.15.133:3300/0 conn(0x7f4f3c068480 0x7f4f3c13ee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:39.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f4148f700 1 --2- 172.21.15.55:0/822576035 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f3c13f370 0x7f4f3c13da90 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:39.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f4148f700 1 -- 172.21.15.55:0/822576035 >> 172.21.15.55:0/822576035 conn(0x7f4f3c0b2f00 msgr2=0x7f4f3c0b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:39.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f4148f700 1 -- 172.21.15.55:0/822576035 shutdown_connections 2023-09-30T01:59:39.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.023+0000 7f4f4148f700 1 -- 172.21.15.55:0/822576035 wait complete. 2023-09-30T01:59:39.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f4148f700 1 Processor -- start 2023-09-30T01:59:39.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f4148f700 1 -- start start 2023-09-30T01:59:39.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f4148f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4f3c0680b0 0x7f4f3c134e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:39.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f4148f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f3c068480 0x7f4f3c136170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:39.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f4148f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f3c13f370 0x7f4f3c14cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:39.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f4148f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c1369c0 con 0x7f4f3c068480 2023-09-30T01:59:39.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f4148f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c14e4e0 con 0x7f4f3c13f370 2023-09-30T01:59:39.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f4148f700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3c14e7a0 con 0x7f4f3c0680b0 2023-09-30T01:59:39.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f3affd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4f3c0680b0 0x7f4f3c134e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:39.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f3a7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f3c068480 0x7f4f3c136170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:39.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f3affd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4f3c0680b0 0x7f4f3c134e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:42936/0 (socket says 172.21.15.55:42936) 2023-09-30T01:59:39.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f3affd700 1 -- 172.21.15.55:0/907217357 learned_addr learned my addr 172.21.15.55:0/907217357 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:39.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f3b7fe700 1 --2- 172.21.15.55:0/907217357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f3c13f370 0x7f4f3c14cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:39.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f3affd700 1 -- 172.21.15.55:0/907217357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f3c13f370 msgr2=0x7f4f3c14cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:39.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f3affd700 1 --2- 172.21.15.55:0/907217357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f3c13f370 0x7f4f3c14cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:39.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f3affd700 1 -- 172.21.15.55:0/907217357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f3c068480 msgr2=0x7f4f3c136170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:39.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f3affd700 1 --2- 172.21.15.55:0/907217357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f3c068480 0x7f4f3c136170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:39.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f3affd700 1 -- 172.21.15.55:0/907217357 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f30009420 con 0x7f4f3c0680b0 2023-09-30T01:59:39.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f3a7fc700 1 --2- 172.21.15.55:0/907217357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f3c068480 0x7f4f3c136170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:59:39.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f3affd700 1 --2- 172.21.15.55:0/907217357 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4f3c0680b0 0x7f4f3c134e10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00cb90 tx=0x7f4f2c001a30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:39.034 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f22ffd700 1 -- 172.21.15.55:0/907217357 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c007150 con 0x7f4f3c0680b0 2023-09-30T01:59:39.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f22ffd700 1 -- 172.21.15.55:0/907217357 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c0072d0 con 0x7f4f3c0680b0 2023-09-30T01:59:39.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f4148f700 1 -- 172.21.15.55:0/907217357 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f34009a20 con 0x7f4f3c0680b0 2023-09-30T01:59:39.036 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f22ffd700 1 -- 172.21.15.55:0/907217357 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c007690 con 0x7f4f3c0680b0 2023-09-30T01:59:39.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.027+0000 7f4f4148f700 1 -- 172.21.15.55:0/907217357 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3c135350 con 0x7f4f3c0680b0 2023-09-30T01:59:39.037 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.031+0000 7f4f4148f700 1 -- 172.21.15.55:0/907217357 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f3c136b00 con 0x7f4f3c0680b0 2023-09-30T01:59:39.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.035+0000 7f4f22ffd700 1 -- 172.21.15.55:0/907217357 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f4f2c004a40 con 0x7f4f3c0680b0 2023-09-30T01:59:39.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.035+0000 7f4f22ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:39.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.035+0000 7f4f22ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:39.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.035+0000 7f4f22ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:39.038 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.035+0000 7f4f22ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:39.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.035+0000 7f4f22ffd700 1 --2- 172.21.15.55:0/907217357 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f4f2808e8b0 0x7f4f28090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:39.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.035+0000 7f4f22ffd700 1 -- 172.21.15.55:0/907217357 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f4f2c0b42e0 con 0x7f4f3c0680b0 2023-09-30T01:59:39.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.035+0000 7f4f3a7fc700 1 --2- 172.21.15.55:0/907217357 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f4f2808e8b0 0x7f4f28090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:39.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.035+0000 7f4f3a7fc700 1 --2- 172.21.15.55:0/907217357 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f4f2808e8b0 0x7f4f28090d60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c132f00 tx=0x7f4f300091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:39.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.039+0000 7f4f22ffd700 1 -- 172.21.15.55:0/907217357 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4f2c084be0 con 0x7f4f3c0680b0 2023-09-30T01:59:39.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.235+0000 7f4f4148f700 1 -- 172.21.15.55:0/907217357 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f4f3c136b00 con 0x7f4f3c0680b0 2023-09-30T01:59:39.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.235+0000 7f4f22ffd700 1 -- 172.21.15.55:0/907217357 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f4f3c136b00 con 0x7f4f3c0680b0 2023-09-30T01:59:39.239 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:39.239 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.239+0000 7f4f4148f700 10 mgrc shutdown 2023-09-30T01:59:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.239+0000 7f4f4148f700 1 -- 172.21.15.55:0/907217357 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f4f2808e8b0 msgr2=0x7f4f28090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.239+0000 7f4f4148f700 1 --2- 172.21.15.55:0/907217357 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f4f2808e8b0 0x7f4f28090d60 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f4f3c132f00 tx=0x7f4f300091a0 comp rx=0 tx=0).stop 2023-09-30T01:59:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.239+0000 7f4f4148f700 1 -- 172.21.15.55:0/907217357 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4f3c0680b0 msgr2=0x7f4f3c134e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.239+0000 7f4f4148f700 1 --2- 172.21.15.55:0/907217357 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4f3c0680b0 0x7f4f3c134e10 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c00cb90 tx=0x7f4f2c001a30 comp rx=0 tx=0).stop 2023-09-30T01:59:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.239+0000 7f4f4148f700 1 -- 172.21.15.55:0/907217357 shutdown_connections 2023-09-30T01:59:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.239+0000 7f4f4148f700 1 --2- 172.21.15.55:0/907217357 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f4f3c13f370 0x7f4f3c14cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.239+0000 7f4f4148f700 1 --2- 172.21.15.55:0/907217357 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f4f3c068480 0x7f4f3c136170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.239+0000 7f4f4148f700 1 --2- 172.21.15.55:0/907217357 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f4f2808e8b0 0x7f4f28090d60 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:39.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.239+0000 7f4f4148f700 1 --2- 172.21.15.55:0/907217357 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f4f3c0680b0 0x7f4f3c134e10 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.239+0000 7f4f4148f700 1 -- 172.21.15.55:0/907217357 >> 172.21.15.55:0/907217357 conn(0x7f4f3c0b2f00 msgr2=0x7f4f3c06ff00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.239+0000 7f4f4148f700 1 -- 172.21.15.55:0/907217357 shutdown_connections 2023-09-30T01:59:39.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:39.239+0000 7f4f4148f700 1 -- 172.21.15.55:0/907217357 wait complete. 2023-09-30T01:59:42.261 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:42.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.371+0000 7f8838e1f700 1 Processor -- start 2023-09-30T01:59:42.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.371+0000 7f8838e1f700 1 -- start start 2023-09-30T01:59:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8838e1f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f88340a4990 0x7f88340aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8838e1f700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88340af120 con 0x7f88340a4d60 2023-09-30T01:59:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8838e1f700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88340af5b0 con 0x7f883413a750 2023-09-30T01:59:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8838e1f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f883409fb10 con 0x7f88340a4990 2023-09-30T01:59:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8832ffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f88340a4d60 0x7f88340a1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:53974/0 (socket says 172.21.15.55:53974) 2023-09-30T01:59:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8832ffd700 1 -- 172.21.15.55:0/2885008638 learned_addr learned my addr 172.21.15.55:0/2885008638 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:59:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88337fe700 1 --2- 172.21.15.55:0/2885008638 >> v2:172.21.15.133:3300/0 conn(0x7f88340a4990 0x7f88340aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:42.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 361756004 0 0) 0x7f88340af120 con 0x7f88340a4d60 2023-09-30T01:59:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f881c003570 con 0x7f88340a4d60 2023-09-30T01:59:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1776988106 0 0) 0x7f88340af5b0 con 0x7f883413a750 2023-09-30T01:59:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88340af120 con 0x7f883413a750 2023-09-30T01:59:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2586480252 0 0) 0x7f881c003570 con 0x7f88340a4d60 2023-09-30T01:59:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 >> v2:172.21.15.133:3300/0 conn(0x7f88340a4990 msgr2=0x7f88340aeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 --2- 172.21.15.55:0/2885008638 >> v2:172.21.15.133:3300/0 conn(0x7f88340a4990 0x7f88340aeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 >> v1:172.21.15.133:6789/0 conn(0x7f883413a750 legacy=0x7f883414ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f883409fdd0 con 0x7f88340a4d60 2023-09-30T01:59:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 254224620 0 0) 0x7f8824001470 con 0x7f88340a4d60 2023-09-30T01:59:42.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 >> v1:172.21.15.55:6789/0 conn(0x7f88340a4d60 legacy=0x7f88340a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 --2- 172.21.15.55:0/2885008638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f881c003bf0 0x7f881c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 --2- 172.21.15.55:0/2885008638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f881c004810 0x7f881c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 --2- 172.21.15.55:0/2885008638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f881c0051c0 0x7f881c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883409fb10 con 0x7f881c004810 2023-09-30T01:59:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f881c00c160 con 0x7f881c0051c0 2023-09-30T01:59:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f881c00c320 con 0x7f881c003bf0 2023-09-30T01:59:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8832ffd700 1 --2- 172.21.15.55:0/2885008638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f881c004810 0x7f881c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88337fe700 1 --2- 172.21.15.55:0/2885008638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f881c003bf0 0x7f881c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8833fff700 1 --2- 172.21.15.55:0/2885008638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f881c0051c0 0x7f881c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8832ffd700 1 -- 172.21.15.55:0/2885008638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f881c003bf0 msgr2=0x7f881c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:42.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8832ffd700 1 --2- 172.21.15.55:0/2885008638 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f881c003bf0 0x7f881c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:42.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8832ffd700 1 -- 172.21.15.55:0/2885008638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f881c0051c0 msgr2=0x7f881c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:42.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8832ffd700 1 --2- 172.21.15.55:0/2885008638 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f881c0051c0 0x7f881c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:42.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8832ffd700 1 -- 172.21.15.55:0/2885008638 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f881c003570 con 0x7f881c004810 2023-09-30T01:59:42.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8833fff700 1 -- 172.21.15.55:0/2885008638 reap_dead start 2023-09-30T01:59:42.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f8832ffd700 1 --2- 172.21.15.55:0/2885008638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f881c004810 0x7f881c004c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f88340a5130 tx=0x7f8824001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d7d9118678c2c8b server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:42.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882400cb60 con 0x7f881c004810 2023-09-30T01:59:42.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882400ccc0 con 0x7f881c004810 2023-09-30T01:59:42.384 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.375+0000 7f88327fc700 1 -- 172.21.15.55:0/2885008638 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824005b70 con 0x7f881c004810 2023-09-30T01:59:42.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.379+0000 7f8838e1f700 1 -- 172.21.15.55:0/2885008638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f881c004810 msgr2=0x7f881c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:42.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.379+0000 7f8838e1f700 1 --2- 172.21.15.55:0/2885008638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f881c004810 0x7f881c004c80 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f88340a5130 tx=0x7f8824001e10 comp rx=0 tx=0).stop 2023-09-30T01:59:42.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.379+0000 7f8838e1f700 1 -- 172.21.15.55:0/2885008638 shutdown_connections 2023-09-30T01:59:42.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.379+0000 7f8838e1f700 1 --2- 172.21.15.55:0/2885008638 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f881c004810 0x7f881c004c80 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:42.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.379+0000 7f8838e1f700 1 -- 172.21.15.55:0/2885008638 >> 172.21.15.55:0/2885008638 conn(0x7f88340b23d0 msgr2=0x7f88340b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:42.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.379+0000 7f8838e1f700 1 -- 172.21.15.55:0/2885008638 shutdown_connections 2023-09-30T01:59:42.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.379+0000 7f8838e1f700 1 -- 172.21.15.55:0/2885008638 wait complete. 2023-09-30T01:59:42.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.379+0000 7f8838e1f700 1 Processor -- start 2023-09-30T01:59:42.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.379+0000 7f8838e1f700 1 -- start start 2023-09-30T01:59:42.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f8838e1f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f881c004810 0x7f8834153f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:42.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f8838e1f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8834138190 0x7f88341385c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:42.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f8838e1f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8834096d40 0x7f88340971b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:42.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f8838e1f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834098940 con 0x7f8834096d40 2023-09-30T01:59:42.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f8838e1f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834098ab0 con 0x7f8834138190 2023-09-30T01:59:42.388 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f8838e1f700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8834097f60 con 0x7f881c004810 2023-09-30T01:59:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f88337fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f881c004810 0x7f8834153f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f8833fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8834096d40 0x7f88340971b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f88337fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f881c004810 0x7f8834153f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:57338/0 (socket says 172.21.15.55:57338) 2023-09-30T01:59:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f88337fe700 1 -- 172.21.15.55:0/4264894822 learned_addr learned my addr 172.21.15.55:0/4264894822 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f8832ffd700 1 --2- 172.21.15.55:0/4264894822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8834138190 0x7f88341385c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f88337fe700 1 -- 172.21.15.55:0/4264894822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8834138190 msgr2=0x7f88341385c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f88337fe700 1 --2- 172.21.15.55:0/4264894822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8834138190 0x7f88341385c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f88337fe700 1 -- 172.21.15.55:0/4264894822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8834096d40 msgr2=0x7f88340971b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:42.389 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f88337fe700 1 --2- 172.21.15.55:0/4264894822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8834096d40 0x7f88340971b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f88337fe700 1 -- 172.21.15.55:0/4264894822 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88341548e0 con 0x7f881c004810 2023-09-30T01:59:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f8833fff700 1 --2- 172.21.15.55:0/4264894822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8834096d40 0x7f88340971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:59:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f88337fe700 1 --2- 172.21.15.55:0/4264894822 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f881c004810 0x7f8834153f60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8828011a40 tx=0x7f88280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f881b7fe700 1 -- 172.21.15.55:0/4264894822 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828011e80 con 0x7f881c004810 2023-09-30T01:59:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f881b7fe700 1 -- 172.21.15.55:0/4264894822 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882800f940 con 0x7f881c004810 2023-09-30T01:59:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f8838e1f700 1 -- 172.21.15.55:0/4264894822 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8834154b80 con 0x7f881c004810 2023-09-30T01:59:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f881b7fe700 1 -- 172.21.15.55:0/4264894822 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882800fcc0 con 0x7f881c004810 2023-09-30T01:59:42.390 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f8838e1f700 1 -- 172.21.15.55:0/4264894822 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88340976f0 con 0x7f881c004810 2023-09-30T01:59:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.383+0000 7f8838e1f700 1 -- 172.21.15.55:0/4264894822 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8834064440 con 0x7f881c004810 2023-09-30T01:59:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.387+0000 7f881b7fe700 1 -- 172.21.15.55:0/4264894822 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f8828014650 con 0x7f881c004810 2023-09-30T01:59:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.387+0000 7f881b7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.387+0000 7f881b7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:42.391 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.387+0000 7f881b7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.387+0000 7f881b7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.387+0000 7f881b7fe700 1 --2- 172.21.15.55:0/4264894822 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f882008e8b0 0x7f8820090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.387+0000 7f8832ffd700 1 --2- 172.21.15.55:0/4264894822 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f882008e8b0 0x7f8820090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.387+0000 7f881b7fe700 1 -- 172.21.15.55:0/4264894822 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f8828018030 con 0x7f881c004810 2023-09-30T01:59:42.392 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.387+0000 7f8832ffd700 1 --2- 172.21.15.55:0/4264894822 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f882008e8b0 0x7f8820090d60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8824008fd0 tx=0x7f8824015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:42.399 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.395+0000 7f881b7fe700 1 -- 172.21.15.55:0/4264894822 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8828085da0 con 0x7f881c004810 2023-09-30T01:59:42.598 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.595+0000 7f8838e1f700 1 -- 172.21.15.55:0/4264894822 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f88340a0090 con 0x7f881c004810 2023-09-30T01:59:42.600 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.595+0000 7f881b7fe700 1 -- 172.21.15.55:0/4264894822 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f8828022080 con 0x7f881c004810 2023-09-30T01:59:42.600 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:42.600 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:42.603 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.599+0000 7f8838e1f700 10 mgrc shutdown 2023-09-30T01:59:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.599+0000 7f8838e1f700 1 -- 172.21.15.55:0/4264894822 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f882008e8b0 msgr2=0x7f8820090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.599+0000 7f8838e1f700 1 --2- 172.21.15.55:0/4264894822 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f882008e8b0 0x7f8820090d60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f8824008fd0 tx=0x7f8824015000 comp rx=0 tx=0).stop 2023-09-30T01:59:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.599+0000 7f8838e1f700 1 -- 172.21.15.55:0/4264894822 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f881c004810 msgr2=0x7f8834153f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.599+0000 7f8838e1f700 1 --2- 172.21.15.55:0/4264894822 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f881c004810 0x7f8834153f60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8828011a40 tx=0x7f88280091a0 comp rx=0 tx=0).stop 2023-09-30T01:59:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.599+0000 7f8838e1f700 1 -- 172.21.15.55:0/4264894822 shutdown_connections 2023-09-30T01:59:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.599+0000 7f8838e1f700 1 --2- 172.21.15.55:0/4264894822 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f8834096d40 0x7f88340971b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:42.604 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.599+0000 7f8838e1f700 1 --2- 172.21.15.55:0/4264894822 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f8834138190 0x7f88341385c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:42.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.599+0000 7f8838e1f700 1 --2- 172.21.15.55:0/4264894822 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f882008e8b0 0x7f8820090d60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:42.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.599+0000 7f8838e1f700 1 --2- 172.21.15.55:0/4264894822 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f881c004810 0x7f8834153f60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:42.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.599+0000 7f8838e1f700 1 -- 172.21.15.55:0/4264894822 >> 172.21.15.55:0/4264894822 conn(0x7f88340b23d0 msgr2=0x7f88340a1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:42.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.599+0000 7f8838e1f700 1 -- 172.21.15.55:0/4264894822 shutdown_connections 2023-09-30T01:59:42.605 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:42.599+0000 7f8838e1f700 1 -- 172.21.15.55:0/4264894822 wait complete. 2023-09-30T01:59:44.168 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:59:44.171 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T01:59:45.616 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:45.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.723+0000 7f3026113700 1 Processor -- start 2023-09-30T01:59:45.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.723+0000 7f3026113700 1 -- start start 2023-09-30T01:59:45.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f30200a55c0 0x7f30200a8890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:45.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30200a8dd0 0x7f302014aa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:45.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30200a48b0 con 0x7f30200672d0 2023-09-30T01:59:45.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30200a3780 con 0x7f30200a55c0 2023-09-30T01:59:45.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30200676a0 con 0x7f30200a8dd0 2023-09-30T01:59:45.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3025912700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30200a8dd0 0x7f302014aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:45.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3025912700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30200a8dd0 0x7f302014aa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:57350/0 (socket says 172.21.15.55:57350) 2023-09-30T01:59:45.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3025912700 1 -- 172.21.15.55:0/591773466 learned_addr learned my addr 172.21.15.55:0/591773466 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:45.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3024910700 1 --2- 172.21.15.55:0/591773466 >> v2:172.21.15.133:3300/0 conn(0x7f30200a55c0 0x7f30200a8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:45.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3025912700 1 -- 172.21.15.55:0/591773466 >> v2:172.21.15.133:3300/0 conn(0x7f30200a55c0 msgr2=0x7f30200a8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:45.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3025912700 1 --2- 172.21.15.55:0/591773466 >> v2:172.21.15.133:3300/0 conn(0x7f30200a55c0 0x7f30200a8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:45.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3025912700 1 -- 172.21.15.55:0/591773466 >> v1:172.21.15.133:6789/0 conn(0x7f30200672d0 legacy=0x7f302013f790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:45.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3025912700 1 -- 172.21.15.55:0/591773466 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30200a3970 con 0x7f30200a8dd0 2023-09-30T01:59:45.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3017fff700 1 -- 172.21.15.55:0/591773466 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692258167 0 0) 0x7f30200a48b0 con 0x7f30200672d0 2023-09-30T01:59:45.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3024910700 1 --2- 172.21.15.55:0/591773466 >> v2:172.21.15.133:3300/0 conn(0x7f30200a55c0 0x7f30200a8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:59:45.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3025912700 1 --2- 172.21.15.55:0/591773466 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30200a8dd0 0x7f302014aa40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3018009f20 tx=0x7f3018009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8def1e8a63c210ab server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:45.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3017fff700 1 -- 172.21.15.55:0/591773466 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301800e070 con 0x7f30200a8dd0 2023-09-30T01:59:45.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3017fff700 1 -- 172.21.15.55:0/591773466 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301800ba80 con 0x7f30200a8dd0 2023-09-30T01:59:45.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3017fff700 1 -- 172.21.15.55:0/591773466 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30180092e0 con 0x7f30200a8dd0 2023-09-30T01:59:45.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 -- 172.21.15.55:0/591773466 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30200a8dd0 msgr2=0x7f302014aa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:45.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 --2- 172.21.15.55:0/591773466 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30200a8dd0 0x7f302014aa40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3018009f20 tx=0x7f3018009840 comp rx=0 tx=0).stop 2023-09-30T01:59:45.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 -- 172.21.15.55:0/591773466 shutdown_connections 2023-09-30T01:59:45.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 --2- 172.21.15.55:0/591773466 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30200a8dd0 0x7f302014aa40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:45.733 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 --2- 172.21.15.55:0/591773466 >> v2:172.21.15.133:3300/0 conn(0x7f30200a55c0 0x7f30200a8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:45.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 -- 172.21.15.55:0/591773466 >> 172.21.15.55:0/591773466 conn(0x7f30200635c0 msgr2=0x7f302006ff20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:45.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 -- 172.21.15.55:0/591773466 shutdown_connections 2023-09-30T01:59:45.734 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 -- 172.21.15.55:0/591773466 wait complete. 2023-09-30T01:59:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 Processor -- start 2023-09-30T01:59:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.727+0000 7f3026113700 1 -- start start 2023-09-30T01:59:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3026113700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30200672d0 0x7f3020142c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3026113700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30200a55c0 0x7f30200b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3026113700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30200a8dd0 0x7f302014e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3026113700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30200b4f50 con 0x7f30200672d0 2023-09-30T01:59:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3026113700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30200b5210 con 0x7f30200a55c0 2023-09-30T01:59:45.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3026113700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30200b4c20 con 0x7f30200a8dd0 2023-09-30T01:59:45.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3025111700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30200672d0 0x7f3020142c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:45.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3025111700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30200672d0 0x7f3020142c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:60504/0 (socket says 172.21.15.55:60504) 2023-09-30T01:59:45.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3025111700 1 -- 172.21.15.55:0/331065296 learned_addr learned my addr 172.21.15.55:0/331065296 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:45.737 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3025912700 1 --2- 172.21.15.55:0/331065296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30200a8dd0 0x7f302014e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3024910700 1 --2- 172.21.15.55:0/331065296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30200a55c0 0x7f30200b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3025111700 1 -- 172.21.15.55:0/331065296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30200a8dd0 msgr2=0x7f302014e9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3025111700 1 --2- 172.21.15.55:0/331065296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30200a8dd0 0x7f302014e9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3025111700 1 -- 172.21.15.55:0/331065296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30200a55c0 msgr2=0x7f30200b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:45.738 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3025111700 1 --2- 172.21.15.55:0/331065296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30200a55c0 0x7f30200b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:45.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3025111700 1 -- 172.21.15.55:0/331065296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018009ae0 con 0x7f30200672d0 2023-09-30T01:59:45.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3025111700 1 --2- 172.21.15.55:0/331065296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30200672d0 0x7f3020142c50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c7e0 tx=0x7f301c007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:45.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f30157fa700 1 -- 172.21.15.55:0/331065296 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c011590 con 0x7f30200672d0 2023-09-30T01:59:45.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f30157fa700 1 -- 172.21.15.55:0/331065296 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f301c011710 con 0x7f30200672d0 2023-09-30T01:59:45.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f30157fa700 1 -- 172.21.15.55:0/331065296 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f301c011ad0 con 0x7f30200672d0 2023-09-30T01:59:45.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3026113700 1 -- 172.21.15.55:0/331065296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3020143470 con 0x7f30200672d0 2023-09-30T01:59:45.739 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3026113700 1 -- 172.21.15.55:0/331065296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f302006ac70 con 0x7f30200672d0 2023-09-30T01:59:45.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.731+0000 7f3026113700 1 -- 172.21.15.55:0/331065296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f302006b230 con 0x7f30200672d0 2023-09-30T01:59:45.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.735+0000 7f30157fa700 1 -- 172.21.15.55:0/331065296 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f301c01c460 con 0x7f30200672d0 2023-09-30T01:59:45.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.735+0000 7f30157fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:45.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.735+0000 7f30157fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:45.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.735+0000 7f30157fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:45.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.735+0000 7f30157fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:45.740 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.735+0000 7f30157fa700 1 --2- 172.21.15.55:0/331065296 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f300408e830 0x7f3004090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.735+0000 7f30157fa700 1 -- 172.21.15.55:0/331065296 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f301c0b5160 con 0x7f30200672d0 2023-09-30T01:59:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.735+0000 7f3024910700 1 --2- 172.21.15.55:0/331065296 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f300408e830 0x7f3004090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:45.741 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.739+0000 7f3024910700 1 --2- 172.21.15.55:0/331065296 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f300408e830 0x7f3004090ce0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3010006f00 tx=0x7f3010008040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:45.745 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.739+0000 7f30157fa700 1 -- 172.21.15.55:0/331065296 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f301c085b00 con 0x7f30200672d0 2023-09-30T01:59:45.946 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.943+0000 7f3026113700 1 -- 172.21.15.55:0/331065296 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3020064440 con 0x7f30200672d0 2023-09-30T01:59:45.947 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.943+0000 7f30157fa700 1 -- 172.21.15.55:0/331065296 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f301c089120 con 0x7f30200672d0 2023-09-30T01:59:45.947 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:45.947 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:45.951 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.947+0000 7f3026113700 10 mgrc shutdown 2023-09-30T01:59:45.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.947+0000 7f3026113700 1 -- 172.21.15.55:0/331065296 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f300408e830 msgr2=0x7f3004090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:45.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.947+0000 7f3026113700 1 --2- 172.21.15.55:0/331065296 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f300408e830 0x7f3004090ce0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f3010006f00 tx=0x7f3010008040 comp rx=0 tx=0).stop 2023-09-30T01:59:45.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.947+0000 7f3026113700 1 -- 172.21.15.55:0/331065296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30200672d0 msgr2=0x7f3020142c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:45.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.947+0000 7f3026113700 1 --2- 172.21.15.55:0/331065296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30200672d0 0x7f3020142c50 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f301c00c7e0 tx=0x7f301c007de0 comp rx=0 tx=0).stop 2023-09-30T01:59:45.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.947+0000 7f3026113700 1 -- 172.21.15.55:0/331065296 shutdown_connections 2023-09-30T01:59:45.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.947+0000 7f3026113700 1 --2- 172.21.15.55:0/331065296 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f300408e830 0x7f3004090ce0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:45.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.947+0000 7f3026113700 1 --2- 172.21.15.55:0/331065296 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f30200a8dd0 0x7f302014e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:45.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.947+0000 7f3026113700 1 --2- 172.21.15.55:0/331065296 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f30200a55c0 0x7f30200b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:45.953 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.947+0000 7f3026113700 1 --2- 172.21.15.55:0/331065296 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f30200672d0 0x7f3020142c50 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:45.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.947+0000 7f3026113700 1 -- 172.21.15.55:0/331065296 >> 172.21.15.55:0/331065296 conn(0x7f30200635c0 msgr2=0x7f30200a7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:45.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.947+0000 7f3026113700 1 -- 172.21.15.55:0/331065296 shutdown_connections 2023-09-30T01:59:45.954 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:45.947+0000 7f3026113700 1 -- 172.21.15.55:0/331065296 wait complete. 2023-09-30T01:59:48.966 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:49.082 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8ffff700 1 Processor -- start 2023-09-30T01:59:49.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8ffff700 1 -- start start 2023-09-30T01:59:49.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8ffff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda9013d5b0 0x7fda900a5fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:49.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8ffff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fda9013d980 0x7fda90140290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:49.083 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8ffff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda90140f00 con 0x7fda900aba80 2023-09-30T01:59:49.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8ffff700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda90143620 con 0x7fda9013d980 2023-09-30T01:59:49.084 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8ffff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda900a64e0 con 0x7fda9013d5b0 2023-09-30T01:59:49.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8e7fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda9013d5b0 0x7fda900a5fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:49.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8f7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fda9013d980 0x7fda90140290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:49.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8e7fc700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda9013d5b0 0x7fda900a5fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:57372/0 (socket says 172.21.15.55:57372) 2023-09-30T01:59:49.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8e7fc700 1 -- 172.21.15.55:0/2087236347 learned_addr learned my addr 172.21.15.55:0/2087236347 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:49.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8f7fe700 1 -- 172.21.15.55:0/2087236347 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda9013d5b0 msgr2=0x7fda900a5fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:49.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8f7fe700 1 --2- 172.21.15.55:0/2087236347 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda9013d5b0 0x7fda900a5fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:49.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8f7fe700 1 -- 172.21.15.55:0/2087236347 >> v1:172.21.15.133:6789/0 conn(0x7fda900aba80 legacy=0x7fda900abe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:49.085 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8f7fe700 1 -- 172.21.15.55:0/2087236347 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda901407d0 con 0x7fda9013d980 2023-09-30T01:59:49.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8f7fe700 1 --2- 172.21.15.55:0/2087236347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9013d980 0x7fda90140290 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fda88009e60 tx=0x7fda88009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bc7422b5e7e68e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:49.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.079+0000 7fda8dffb700 1 -- 172.21.15.55:0/2087236347 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda8800e070 con 0x7fda9013d980 2023-09-30T01:59:49.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8dffb700 1 -- 172.21.15.55:0/2087236347 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda8800bb60 con 0x7fda9013d980 2023-09-30T01:59:49.086 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8dffb700 1 -- 172.21.15.55:0/2087236347 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88012430 con 0x7fda9013d980 2023-09-30T01:59:49.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 -- 172.21.15.55:0/2087236347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9013d980 msgr2=0x7fda90140290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:49.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 --2- 172.21.15.55:0/2087236347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9013d980 0x7fda90140290 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fda88009e60 tx=0x7fda88009780 comp rx=0 tx=0).stop 2023-09-30T01:59:49.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 -- 172.21.15.55:0/2087236347 shutdown_connections 2023-09-30T01:59:49.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 --2- 172.21.15.55:0/2087236347 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9013d980 0x7fda90140290 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:49.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 --2- 172.21.15.55:0/2087236347 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda9013d5b0 0x7fda900a5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:49.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 -- 172.21.15.55:0/2087236347 >> 172.21.15.55:0/2087236347 conn(0x7fda900681b0 msgr2=0x7fda900685b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:49.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 -- 172.21.15.55:0/2087236347 shutdown_connections 2023-09-30T01:59:49.087 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 -- 172.21.15.55:0/2087236347 wait complete. 2023-09-30T01:59:49.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 Processor -- start 2023-09-30T01:59:49.088 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 -- start start 2023-09-30T01:59:49.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda900aba80 0x7fda9013b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:49.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9013d5b0 0x7fda9011b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:49.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda9013d980 0x7fda90153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:49.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda90154320 con 0x7fda9013d5b0 2023-09-30T01:59:49.089 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda9011b8d0 con 0x7fda900aba80 2023-09-30T01:59:49.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8ffff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda90154060 con 0x7fda9013d980 2023-09-30T01:59:49.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8e7fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9013d5b0 0x7fda9011b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:49.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8f7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda9013d980 0x7fda90153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:49.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8f7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda9013d980 0x7fda90153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:57388/0 (socket says 172.21.15.55:57388) 2023-09-30T01:59:49.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8f7fe700 1 -- 172.21.15.55:0/2015386019 learned_addr learned my addr 172.21.15.55:0/2015386019 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:49.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8effd700 1 --2- 172.21.15.55:0/2015386019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda900aba80 0x7fda9013b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:49.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8f7fe700 1 -- 172.21.15.55:0/2015386019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda900aba80 msgr2=0x7fda9013b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:49.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8f7fe700 1 --2- 172.21.15.55:0/2015386019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda900aba80 0x7fda9013b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:49.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8f7fe700 1 -- 172.21.15.55:0/2015386019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9013d5b0 msgr2=0x7fda9011b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:49.090 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8f7fe700 1 --2- 172.21.15.55:0/2015386019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9013d5b0 0x7fda9011b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:49.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.083+0000 7fda8f7fe700 1 -- 172.21.15.55:0/2015386019 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda88009a20 con 0x7fda9013d980 2023-09-30T01:59:49.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.087+0000 7fda8e7fc700 1 --2- 172.21.15.55:0/2015386019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9013d5b0 0x7fda9011b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:59:49.091 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.087+0000 7fda8f7fe700 1 --2- 172.21.15.55:0/2015386019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda9013d980 0x7fda90153610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fda88013000 tx=0x7fda88019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:49.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.087+0000 7fda76ffd700 1 -- 172.21.15.55:0/2015386019 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda88027470 con 0x7fda9013d980 2023-09-30T01:59:49.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.087+0000 7fda76ffd700 1 -- 172.21.15.55:0/2015386019 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda88027610 con 0x7fda9013d980 2023-09-30T01:59:49.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.087+0000 7fda8ffff700 1 -- 172.21.15.55:0/2015386019 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda900af010 con 0x7fda9013d980 2023-09-30T01:59:49.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.087+0000 7fda76ffd700 1 -- 172.21.15.55:0/2015386019 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda880279d0 con 0x7fda9013d980 2023-09-30T01:59:49.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.087+0000 7fda8ffff700 1 -- 172.21.15.55:0/2015386019 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda90153b50 con 0x7fda9013d980 2023-09-30T01:59:49.092 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.087+0000 7fda8ffff700 1 -- 172.21.15.55:0/2015386019 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda90064440 con 0x7fda9013d980 2023-09-30T01:59:49.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.087+0000 7fda76ffd700 1 -- 172.21.15.55:0/2015386019 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fda88024070 con 0x7fda9013d980 2023-09-30T01:59:49.093 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.087+0000 7fda76ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:49.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.091+0000 7fda76ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:49.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.091+0000 7fda76ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:49.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.091+0000 7fda76ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:49.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.091+0000 7fda76ffd700 1 --2- 172.21.15.55:0/2015386019 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fda7c08e8b0 0x7fda7c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:49.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.091+0000 7fda8effd700 1 --2- 172.21.15.55:0/2015386019 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fda7c08e8b0 0x7fda7c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:49.094 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.091+0000 7fda76ffd700 1 -- 172.21.15.55:0/2015386019 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fda880b72e0 con 0x7fda9013d980 2023-09-30T01:59:49.095 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.091+0000 7fda8effd700 1 --2- 172.21.15.55:0/2015386019 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fda7c08e8b0 0x7fda7c090d60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda80000c00 tx=0x7fda80009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:49.103 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.099+0000 7fda76ffd700 1 -- 172.21.15.55:0/2015386019 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fda88087d10 con 0x7fda9013d980 2023-09-30T01:59:49.301 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.295+0000 7fda8ffff700 1 -- 172.21.15.55:0/2015386019 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fda9006d370 con 0x7fda9013d980 2023-09-30T01:59:49.302 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.299+0000 7fda76ffd700 1 -- 172.21.15.55:0/2015386019 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fda8808b330 con 0x7fda9013d980 2023-09-30T01:59:49.302 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:49.302 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:49.305 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.299+0000 7fda8ffff700 10 mgrc shutdown 2023-09-30T01:59:49.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.299+0000 7fda8ffff700 1 -- 172.21.15.55:0/2015386019 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fda7c08e8b0 msgr2=0x7fda7c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:49.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.299+0000 7fda8ffff700 1 --2- 172.21.15.55:0/2015386019 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fda7c08e8b0 0x7fda7c090d60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fda80000c00 tx=0x7fda80009040 comp rx=0 tx=0).stop 2023-09-30T01:59:49.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.299+0000 7fda8ffff700 1 -- 172.21.15.55:0/2015386019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda9013d980 msgr2=0x7fda90153610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:49.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.299+0000 7fda8ffff700 1 --2- 172.21.15.55:0/2015386019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda9013d980 0x7fda90153610 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fda88013000 tx=0x7fda88019000 comp rx=0 tx=0).stop 2023-09-30T01:59:49.306 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.299+0000 7fda8ffff700 1 -- 172.21.15.55:0/2015386019 shutdown_connections 2023-09-30T01:59:49.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.299+0000 7fda8ffff700 1 --2- 172.21.15.55:0/2015386019 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fda7c08e8b0 0x7fda7c090d60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:49.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.299+0000 7fda8ffff700 1 --2- 172.21.15.55:0/2015386019 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fda9013d980 0x7fda90153610 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:49.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.299+0000 7fda8ffff700 1 --2- 172.21.15.55:0/2015386019 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fda9013d5b0 0x7fda9011b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:49.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.299+0000 7fda8ffff700 1 --2- 172.21.15.55:0/2015386019 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fda900aba80 0x7fda9013b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:49.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.299+0000 7fda8ffff700 1 -- 172.21.15.55:0/2015386019 >> 172.21.15.55:0/2015386019 conn(0x7fda900681b0 msgr2=0x7fda9006d610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:49.307 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.299+0000 7fda8ffff700 1 -- 172.21.15.55:0/2015386019 shutdown_connections 2023-09-30T01:59:49.308 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:49.299+0000 7fda8ffff700 1 -- 172.21.15.55:0/2015386019 wait complete. 2023-09-30T01:59:52.321 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:52.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 Processor -- start 2023-09-30T01:59:52.438 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 -- start start 2023-09-30T01:59:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06d40682e0 0x7f06d406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f06d406d080 0x7f06d413ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f06d413cfc0 0x7f06d406ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d406d490 con 0x7f06d406d080 2023-09-30T01:59:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d406b6b0 con 0x7f06d413cfc0 2023-09-30T01:59:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40a53e0 con 0x7f06d40682e0 2023-09-30T01:59:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06d40682e0 0x7f06d406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06d40682e0 0x7f06d406cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:44602/0 (socket says 172.21.15.55:44602) 2023-09-30T01:59:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d37fe700 1 -- 172.21.15.55:0/3257849954 learned_addr learned my addr 172.21.15.55:0/3257849954 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:52.440 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d2ffd700 1 --2- 172.21.15.55:0/3257849954 >> v2:172.21.15.55:3300/0 conn(0x7f06d406d080 0x7f06d413ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d3fff700 1 --2- 172.21.15.55:0/3257849954 >> v2:172.21.15.133:3300/0 conn(0x7f06d413cfc0 0x7f06d406ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d37fe700 1 -- 172.21.15.55:0/3257849954 >> v2:172.21.15.133:3300/0 conn(0x7f06d413cfc0 msgr2=0x7f06d406ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d37fe700 1 --2- 172.21.15.55:0/3257849954 >> v2:172.21.15.133:3300/0 conn(0x7f06d413cfc0 0x7f06d406ff20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d37fe700 1 -- 172.21.15.55:0/3257849954 >> v2:172.21.15.55:3300/0 conn(0x7f06d406d080 msgr2=0x7f06d413ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d37fe700 1 --2- 172.21.15.55:0/3257849954 >> v2:172.21.15.55:3300/0 conn(0x7f06d406d080 0x7f06d413ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d37fe700 1 -- 172.21.15.55:0/3257849954 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d40686b0 con 0x7f06d40682e0 2023-09-30T01:59:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d2ffd700 1 --2- 172.21.15.55:0/3257849954 >> v2:172.21.15.55:3300/0 conn(0x7f06d406d080 0x7f06d413ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:59:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d37fe700 1 --2- 172.21.15.55:0/3257849954 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06d40682e0 0x7f06d406cb40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f06d4063730 tx=0x7f06bc00b4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7796d5e9c112568e server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d27fc700 1 -- 172.21.15.55:0/3257849954 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc005c10 con 0x7f06d40682e0 2023-09-30T01:59:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d27fc700 1 -- 172.21.15.55:0/3257849954 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06bc005d70 con 0x7f06d40682e0 2023-09-30T01:59:52.441 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d27fc700 1 -- 172.21.15.55:0/3257849954 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc00dc30 con 0x7f06d40682e0 2023-09-30T01:59:52.442 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 -- 172.21.15.55:0/3257849954 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06d40682e0 msgr2=0x7f06d406cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:52.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 --2- 172.21.15.55:0/3257849954 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06d40682e0 0x7f06d406cb40 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f06d4063730 tx=0x7f06bc00b4c0 comp rx=0 tx=0).stop 2023-09-30T01:59:52.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 -- 172.21.15.55:0/3257849954 shutdown_connections 2023-09-30T01:59:52.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 --2- 172.21.15.55:0/3257849954 >> v2:172.21.15.133:3300/0 conn(0x7f06d413cfc0 0x7f06d406ff20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:52.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 --2- 172.21.15.55:0/3257849954 >> v2:172.21.15.55:3300/0 conn(0x7f06d406d080 0x7f06d413ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:52.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 --2- 172.21.15.55:0/3257849954 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06d40682e0 0x7f06d406cb40 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:52.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 -- 172.21.15.55:0/3257849954 >> 172.21.15.55:0/3257849954 conn(0x7f06d40b2cf0 msgr2=0x7f06d40b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:52.443 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 -- 172.21.15.55:0/3257849954 shutdown_connections 2023-09-30T01:59:52.445 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.435+0000 7f06d88da700 1 -- 172.21.15.55:0/3257849954 wait complete. 2023-09-30T01:59:52.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d88da700 1 Processor -- start 2023-09-30T01:59:52.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d88da700 1 -- start start 2023-09-30T01:59:52.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d88da700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06d40682e0 0x7f06d413fee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:52.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d88da700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06d406d080 0x7f06d414eea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:52.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d88da700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06d413cfc0 0x7f06d40aa520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:52.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d88da700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d414fb30 con 0x7f06d40682e0 2023-09-30T01:59:52.447 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d88da700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d414f870 con 0x7f06d413cfc0 2023-09-30T01:59:52.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d88da700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4140420 con 0x7f06d406d080 2023-09-30T01:59:52.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d2ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06d406d080 0x7f06d414eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:52.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d37fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06d40682e0 0x7f06d413fee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:52.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d2ffd700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06d406d080 0x7f06d414eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:44604/0 (socket says 172.21.15.55:44604) 2023-09-30T01:59:52.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d2ffd700 1 -- 172.21.15.55:0/140786931 learned_addr learned my addr 172.21.15.55:0/140786931 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:52.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d3fff700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06d413cfc0 0x7f06d40aa520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:52.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d2ffd700 1 -- 172.21.15.55:0/140786931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06d413cfc0 msgr2=0x7f06d40aa520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:52.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d2ffd700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06d413cfc0 0x7f06d40aa520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:52.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d2ffd700 1 -- 172.21.15.55:0/140786931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06d40682e0 msgr2=0x7f06d413fee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:52.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.439+0000 7f06d2ffd700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06d40682e0 0x7f06d413fee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:52.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.443+0000 7f06d2ffd700 1 -- 172.21.15.55:0/140786931 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06bc00b720 con 0x7f06d406d080 2023-09-30T01:59:52.448 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.443+0000 7f06d3fff700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06d413cfc0 0x7f06d40aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:59:52.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.443+0000 7f06d37fe700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06d40682e0 0x7f06d413fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T01:59:52.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.443+0000 7f06d2ffd700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06d406d080 0x7f06d414eea0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f06c400d1d0 tx=0x7f06c4009a90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:52.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.443+0000 7f06cb7fe700 1 -- 172.21.15.55:0/140786931 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c400ddc0 con 0x7f06d406d080 2023-09-30T01:59:52.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.443+0000 7f06cb7fe700 1 -- 172.21.15.55:0/140786931 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c400f040 con 0x7f06d406d080 2023-09-30T01:59:52.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.443+0000 7f06d88da700 1 -- 172.21.15.55:0/140786931 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d414f3e0 con 0x7f06d406d080 2023-09-30T01:59:52.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.443+0000 7f06cb7fe700 1 -- 172.21.15.55:0/140786931 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c4015670 con 0x7f06d406d080 2023-09-30T01:59:52.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.443+0000 7f06d88da700 1 -- 172.21.15.55:0/140786931 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d40aac80 con 0x7f06d406d080 2023-09-30T01:59:52.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.443+0000 7f06d88da700 1 -- 172.21.15.55:0/140786931 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d414ebe0 con 0x7f06d406d080 2023-09-30T01:59:52.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.447+0000 7f06cb7fe700 1 -- 172.21.15.55:0/140786931 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f06c4015a60 con 0x7f06d406d080 2023-09-30T01:59:52.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.447+0000 7f06cb7fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:52.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.447+0000 7f06cb7fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:52.450 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.447+0000 7f06cb7fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:52.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.447+0000 7f06cb7fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:52.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.447+0000 7f06cb7fe700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f06b408e8b0 0x7f06b4090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:52.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.447+0000 7f06d37fe700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f06b408e8b0 0x7f06b4090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:52.451 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.447+0000 7f06cb7fe700 1 -- 172.21.15.55:0/140786931 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f06c40b4d30 con 0x7f06d406d080 2023-09-30T01:59:52.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.447+0000 7f06d37fe700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f06b408e8b0 0x7f06b4090d60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00b500 tx=0x7f06bc01a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:52.456 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.451+0000 7f06cb7fe700 1 -- 172.21.15.55:0/140786931 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f06c404cbe0 con 0x7f06d406d080 2023-09-30T01:59:52.651 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.647+0000 7f06d88da700 1 -- 172.21.15.55:0/140786931 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f06d40aaf00 con 0x7f06d406d080 2023-09-30T01:59:52.663 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.659+0000 7f06cb7fe700 1 -- 172.21.15.55:0/140786931 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f06c401a080 con 0x7f06d406d080 2023-09-30T01:59:52.664 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:52.664 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:52.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.663+0000 7f06d88da700 10 mgrc shutdown 2023-09-30T01:59:52.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.663+0000 7f06d88da700 1 -- 172.21.15.55:0/140786931 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f06b408e8b0 msgr2=0x7f06b4090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.663+0000 7f06d88da700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f06b408e8b0 0x7f06b4090d60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00b500 tx=0x7f06bc01a000 comp rx=0 tx=0).stop 2023-09-30T01:59:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.663+0000 7f06d88da700 1 -- 172.21.15.55:0/140786931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06d406d080 msgr2=0x7f06d414eea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.663+0000 7f06d88da700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06d406d080 0x7f06d414eea0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f06c400d1d0 tx=0x7f06c4009a90 comp rx=0 tx=0).stop 2023-09-30T01:59:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.663+0000 7f06d88da700 1 -- 172.21.15.55:0/140786931 shutdown_connections 2023-09-30T01:59:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.663+0000 7f06d88da700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f06d413cfc0 0x7f06d40aa520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.663+0000 7f06d88da700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f06b408e8b0 0x7f06b4090d60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.663+0000 7f06d88da700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f06d406d080 0x7f06d414eea0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.663+0000 7f06d88da700 1 --2- 172.21.15.55:0/140786931 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f06d40682e0 0x7f06d413fee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.663+0000 7f06d88da700 1 -- 172.21.15.55:0/140786931 >> 172.21.15.55:0/140786931 conn(0x7f06d40b2cf0 msgr2=0x7f06d40a4760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.663+0000 7f06d88da700 1 -- 172.21.15.55:0/140786931 shutdown_connections 2023-09-30T01:59:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:52.663+0000 7f06d88da700 1 -- 172.21.15.55:0/140786931 wait complete. 2023-09-30T01:59:55.681 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:55.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.783+0000 7fb1b9ed9700 1 Processor -- start 2023-09-30T01:59:55.789 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.783+0000 7fb1b9ed9700 1 -- start start 2023-09-30T01:59:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b9ed9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fb1b40674d0 0x7fb1b406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b9ed9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1b4135f30 0x7fb1b4136320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b9ed9700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1b406c200 con 0x7fb1b4143590 2023-09-30T01:59:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b9ed9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b40678a0 con 0x7fb1b4135f30 2023-09-30T01:59:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b9ed9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1b40a7dc0 con 0x7fb1b40674d0 2023-09-30T01:59:55.790 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1aaffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fb1b4135f30 0x7fb1b4136320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:55.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b3fff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fb1b4143590 0x7fb1b41439f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57254/0 (socket says 172.21.15.55:57254) 2023-09-30T01:59:55.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b3fff700 1 -- 172.21.15.55:0/2236101650 learned_addr learned my addr 172.21.15.55:0/2236101650 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:59:55.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b37fe700 1 --2- 172.21.15.55:0/2236101650 >> v2:172.21.15.133:3300/0 conn(0x7fb1b40674d0 0x7fb1b406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:55.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1aaffd700 1 -- 172.21.15.55:0/2236101650 >> v2:172.21.15.133:3300/0 conn(0x7fb1b40674d0 msgr2=0x7fb1b406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T01:59:55.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1aaffd700 1 --2- 172.21.15.55:0/2236101650 >> v2:172.21.15.133:3300/0 conn(0x7fb1b40674d0 0x7fb1b406b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:55.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1aaffd700 1 -- 172.21.15.55:0/2236101650 >> v1:172.21.15.55:6789/0 conn(0x7fb1b4143590 legacy=0x7fb1b41439f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:55.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1aaffd700 1 -- 172.21.15.55:0/2236101650 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1b4144220 con 0x7fb1b4135f30 2023-09-30T01:59:55.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1aaffd700 1 --2- 172.21.15.55:0/2236101650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b4135f30 0x7fb1b4136320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40a7fa0 tx=0x7fb19c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ff6bfd0017d9366 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:55.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b2ffd700 1 -- 172.21.15.55:0/2236101650 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c00b690 con 0x7fb1b4135f30 2023-09-30T01:59:55.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b2ffd700 1 -- 172.21.15.55:0/2236101650 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c00b7f0 con 0x7fb1b4135f30 2023-09-30T01:59:55.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b2ffd700 1 -- 172.21.15.55:0/2236101650 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c00bb90 con 0x7fb1b4135f30 2023-09-30T01:59:55.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/2236101650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b4135f30 msgr2=0x7fb1b4136320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:55.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b9ed9700 1 --2- 172.21.15.55:0/2236101650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b4135f30 0x7fb1b4136320 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fb1b40a7fa0 tx=0x7fb19c0091a0 comp rx=0 tx=0).stop 2023-09-30T01:59:55.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/2236101650 shutdown_connections 2023-09-30T01:59:55.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b9ed9700 1 --2- 172.21.15.55:0/2236101650 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b4135f30 0x7fb1b4136320 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:55.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b9ed9700 1 --2- 172.21.15.55:0/2236101650 >> v2:172.21.15.133:3300/0 conn(0x7fb1b40674d0 0x7fb1b406b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:55.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/2236101650 >> 172.21.15.55:0/2236101650 conn(0x7fb1b4062e80 msgr2=0x7fb1b4063250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:55.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/2236101650 shutdown_connections 2023-09-30T01:59:55.793 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.787+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/2236101650 wait complete. 2023-09-30T01:59:55.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b9ed9700 1 Processor -- start 2023-09-30T01:59:55.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b9ed9700 1 -- start start 2023-09-30T01:59:55.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b9ed9700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1b40674d0 0x7fb1b4137950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:55.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b9ed9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1b4135f30 0x7fb1b414fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:55.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b9ed9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b4143590 0x7fb1b40b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:55.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b9ed9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b4150390 con 0x7fb1b4143590 2023-09-30T01:59:55.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b9ed9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b4137250 con 0x7fb1b4135f30 2023-09-30T01:59:55.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b9ed9700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1b4150580 con 0x7fb1b40674d0 2023-09-30T01:59:55.796 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1b40674d0 0x7fb1b4137950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:55.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1b40674d0 0x7fb1b4137950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:44614/0 (socket says 172.21.15.55:44614) 2023-09-30T01:59:55.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b37fe700 1 -- 172.21.15.55:0/3097271549 learned_addr learned my addr 172.21.15.55:0/3097271549 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:55.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b3fff700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b4143590 0x7fb1b40b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:55.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1aaffd700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1b4135f30 0x7fb1b414fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:55.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b37fe700 1 -- 172.21.15.55:0/3097271549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1b4135f30 msgr2=0x7fb1b414fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:55.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b37fe700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1b4135f30 0x7fb1b414fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:55.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b37fe700 1 -- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b4143590 msgr2=0x7fb1b40b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:55.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b37fe700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b4143590 0x7fb1b40b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:55.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b37fe700 1 -- 172.21.15.55:0/3097271549 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb19c009420 con 0x7fb1b40674d0 2023-09-30T01:59:55.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b3fff700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b4143590 0x7fb1b40b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T01:59:55.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b37fe700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1b40674d0 0x7fb1b4137950 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400e930 tx=0x7fb1a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:55.797 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1abfff700 1 -- 172.21.15.55:0/3097271549 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400eed0 con 0x7fb1b40674d0 2023-09-30T01:59:55.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1abfff700 1 -- 172.21.15.55:0/3097271549 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1a400c8e0 con 0x7fb1b40674d0 2023-09-30T01:59:55.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/3097271549 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1b4150840 con 0x7fb1b40674d0 2023-09-30T01:59:55.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1abfff700 1 -- 172.21.15.55:0/3097271549 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1a400cc80 con 0x7fb1b40674d0 2023-09-30T01:59:55.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.791+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/3097271549 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1b4138250 con 0x7fb1b40674d0 2023-09-30T01:59:55.798 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.795+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/3097271549 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1b4063960 con 0x7fb1b40674d0 2023-09-30T01:59:55.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.795+0000 7fb1abfff700 1 -- 172.21.15.55:0/3097271549 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fb1a4013680 con 0x7fb1b40674d0 2023-09-30T01:59:55.800 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.795+0000 7fb1abfff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:55.801 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.799+0000 7fb1abfff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:55.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.799+0000 7fb1abfff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:55.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.799+0000 7fb1abfff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:55.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.799+0000 7fb1abfff700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb19408e8b0 0x7fb194090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:55.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.799+0000 7fb1aaffd700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb19408e8b0 0x7fb194090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:55.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.799+0000 7fb1abfff700 1 -- 172.21.15.55:0/3097271549 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fb1a40b5370 con 0x7fb1b40674d0 2023-09-30T01:59:55.802 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.799+0000 7fb1aaffd700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb19408e8b0 0x7fb194090d60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0093f0 tx=0x7fb19c017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:55.807 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.803+0000 7fb1abfff700 1 -- 172.21.15.55:0/3097271549 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fb1a4085c70 con 0x7fb1b40674d0 2023-09-30T01:59:55.998 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.995+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/3097271549 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fb1b406a850 con 0x7fb1b40674d0 2023-09-30T01:59:55.999 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.995+0000 7fb1abfff700 1 -- 172.21.15.55:0/3097271549 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fb1a4021100 con 0x7fb1b40674d0 2023-09-30T01:59:55.999 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:55.999 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.995+0000 7fb1b9ed9700 10 mgrc shutdown 2023-09-30T01:59:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.995+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb19408e8b0 msgr2=0x7fb194090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:56.001 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.995+0000 7fb1b9ed9700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb19408e8b0 0x7fb194090d60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fb19c0093f0 tx=0x7fb19c017000 comp rx=0 tx=0).stop 2023-09-30T01:59:56.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.995+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1b40674d0 msgr2=0x7fb1b4137950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:56.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.995+0000 7fb1b9ed9700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1b40674d0 0x7fb1b4137950 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb1a400e930 tx=0x7fb1a40091a0 comp rx=0 tx=0).stop 2023-09-30T01:59:56.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.995+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/3097271549 shutdown_connections 2023-09-30T01:59:56.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.995+0000 7fb1b9ed9700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fb1b4143590 0x7fb1b40b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:56.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.995+0000 7fb1b9ed9700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fb1b4135f30 0x7fb1b414fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:56.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.995+0000 7fb1b9ed9700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fb19408e8b0 0x7fb194090d60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:56.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.995+0000 7fb1b9ed9700 1 --2- 172.21.15.55:0/3097271549 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fb1b40674d0 0x7fb1b4137950 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:56.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.999+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/3097271549 >> 172.21.15.55:0/3097271549 conn(0x7fb1b4062e80 msgr2=0x7fb1b4132eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:56.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.999+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/3097271549 shutdown_connections 2023-09-30T01:59:56.002 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:55.999+0000 7fb1b9ed9700 1 -- 172.21.15.55:0/3097271549 wait complete. 2023-09-30T01:59:59.015 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T01:59:59.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.123+0000 7f83814e0700 1 Processor -- start 2023-09-30T01:59:59.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.123+0000 7f83814e0700 1 -- start start 2023-09-30T01:59:59.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f83814e0700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f837c147860 0x7f837c0a7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:59.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f83814e0700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837c0a7ff0 con 0x7f837c0b3b60 2023-09-30T01:59:59.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f83814e0700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f837c0b3f30 con 0x7f837c13a400 2023-09-30T01:59:59.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f83814e0700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f837c0a5050 con 0x7f837c147860 2023-09-30T01:59:59.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f837bfff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f837c0b3b60 0x7f837c147f90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:57262/0 (socket says 172.21.15.55:57262) 2023-09-30T01:59:59.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f837bfff700 1 -- 172.21.15.55:0/1115172035 learned_addr learned my addr 172.21.15.55:0/1115172035 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T01:59:59.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f837b7fe700 1 --2- 172.21.15.55:0/1115172035 >> v2:172.21.15.133:3300/0 conn(0x7f837c147860 0x7f837c0a7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:59.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f837affd700 1 -- 172.21.15.55:0/1115172035 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3783146805 0 0) 0x7f836c001290 con 0x7f837c0b3b60 2023-09-30T01:59:59.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f837affd700 1 -- 172.21.15.55:0/1115172035 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8364003570 con 0x7f837c0b3b60 2023-09-30T01:59:59.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f837b7fe700 1 -- 172.21.15.55:0/1115172035 >> v1:172.21.15.133:6789/0 conn(0x7f837c13a400 legacy=0x7f837c14eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:59.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f837b7fe700 1 -- 172.21.15.55:0/1115172035 >> v1:172.21.15.55:6789/0 conn(0x7f837c0b3b60 legacy=0x7f837c147f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:59.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f837b7fe700 1 -- 172.21.15.55:0/1115172035 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c0a5310 con 0x7f837c147860 2023-09-30T01:59:59.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f837b7fe700 1 --2- 172.21.15.55:0/1115172035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837c147860 0x7f837c0a7ab0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f837c0a5500 tx=0x7f83700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=59a4d810443848d2 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:59.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f837affd700 1 -- 172.21.15.55:0/1115172035 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370011630 con 0x7f837c147860 2023-09-30T01:59:59.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f837affd700 1 -- 172.21.15.55:0/1115172035 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8370011790 con 0x7f837c147860 2023-09-30T01:59:59.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f837affd700 1 -- 172.21.15.55:0/1115172035 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8370011b50 con 0x7f837c147860 2023-09-30T01:59:59.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f83814e0700 1 -- 172.21.15.55:0/1115172035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837c147860 msgr2=0x7f837c0a7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:59.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f83814e0700 1 --2- 172.21.15.55:0/1115172035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837c147860 0x7f837c0a7ab0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f837c0a5500 tx=0x7f83700091a0 comp rx=0 tx=0).stop 2023-09-30T01:59:59.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f83814e0700 1 -- 172.21.15.55:0/1115172035 shutdown_connections 2023-09-30T01:59:59.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f83814e0700 1 --2- 172.21.15.55:0/1115172035 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837c147860 0x7f837c0a7ab0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:59.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f83814e0700 1 -- 172.21.15.55:0/1115172035 >> 172.21.15.55:0/1115172035 conn(0x7f837c062e20 msgr2=0x7f837c063220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:59.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f83814e0700 1 -- 172.21.15.55:0/1115172035 shutdown_connections 2023-09-30T01:59:59.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.127+0000 7f83814e0700 1 -- 172.21.15.55:0/1115172035 wait complete. 2023-09-30T01:59:59.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f83814e0700 1 Processor -- start 2023-09-30T01:59:59.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f83814e0700 1 -- start start 2023-09-30T01:59:59.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f83814e0700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f837c0b3b60 0x7f837c1439b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:59.136 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f83814e0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f837c13a400 0x7f837c1548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:59.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f83814e0700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837c147860 0x7f837c1423a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:59.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f83814e0700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c13e740 con 0x7f837c0b3b60 2023-09-30T01:59:59.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f83814e0700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f837c155280 con 0x7f837c147860 2023-09-30T01:59:59.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f83814e0700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f837c0b47b0 con 0x7f837c13a400 2023-09-30T01:59:59.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f837b7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f837c13a400 0x7f837c1548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:59.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f837b7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f837c13a400 0x7f837c1548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:44630/0 (socket says 172.21.15.55:44630) 2023-09-30T01:59:59.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f837b7fe700 1 -- 172.21.15.55:0/1862975493 learned_addr learned my addr 172.21.15.55:0/1862975493 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T01:59:59.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f837bfff700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f837c0b3b60 0x7f837c1439b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:59.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f8380cdf700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837c147860 0x7f837c1423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:59.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f837b7fe700 1 -- 172.21.15.55:0/1862975493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837c147860 msgr2=0x7f837c1423a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:59.137 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f837b7fe700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837c147860 0x7f837c1423a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:59.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f837b7fe700 1 -- 172.21.15.55:0/1862975493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f837c0b3b60 msgr2=0x7f837c1439b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:59.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f837b7fe700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f837c0b3b60 0x7f837c1439b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:59.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f837b7fe700 1 -- 172.21.15.55:0/1862975493 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8370009420 con 0x7f837c13a400 2023-09-30T01:59:59.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f8380cdf700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837c147860 0x7f837c1423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T01:59:59.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f837b7fe700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f837c13a400 0x7f837c1548b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8370013000 tx=0x7f8370016000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:59.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f8363fff700 1 -- 172.21.15.55:0/1862975493 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837001ae60 con 0x7f837c13a400 2023-09-30T01:59:59.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f8363fff700 1 -- 172.21.15.55:0/1862975493 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837001f070 con 0x7f837c13a400 2023-09-30T01:59:59.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f83814e0700 1 -- 172.21.15.55:0/1862975493 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f837c1401e0 con 0x7f837c13a400 2023-09-30T01:59:59.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f8363fff700 1 -- 172.21.15.55:0/1862975493 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83700266d0 con 0x7f837c13a400 2023-09-30T01:59:59.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.131+0000 7f83814e0700 1 -- 172.21.15.55:0/1862975493 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f837c144110 con 0x7f837c13a400 2023-09-30T01:59:59.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.135+0000 7f83814e0700 1 -- 172.21.15.55:0/1862975493 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f837c1442a0 con 0x7f837c13a400 2023-09-30T01:59:59.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.135+0000 7f8363fff700 1 -- 172.21.15.55:0/1862975493 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f837001b450 con 0x7f837c13a400 2023-09-30T01:59:59.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.135+0000 7f8363fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T01:59:59.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.135+0000 7f8363fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T01:59:59.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.135+0000 7f8363fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:59.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.135+0000 7f8363fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T01:59:59.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.135+0000 7f8363fff700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f836808e8b0 0x7f8368090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T01:59:59.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.135+0000 7f8363fff700 1 -- 172.21.15.55:0/1862975493 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f8370021070 con 0x7f837c13a400 2023-09-30T01:59:59.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.135+0000 7f837bfff700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f836808e8b0 0x7f8368090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T01:59:59.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.135+0000 7f837bfff700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f836808e8b0 0x7f8368090d60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f836c0013f0 tx=0x7f836c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T01:59:59.146 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.143+0000 7f8363fff700 1 -- 172.21.15.55:0/1862975493 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f8370086ef0 con 0x7f837c13a400 2023-09-30T01:59:59.339 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.335+0000 7f83814e0700 1 -- 172.21.15.55:0/1862975493 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f837c064440 con 0x7f837c13a400 2023-09-30T01:59:59.340 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.335+0000 7f8363fff700 1 -- 172.21.15.55:0/1862975493 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f837008a510 con 0x7f837c13a400 2023-09-30T01:59:59.340 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T01:59:59.340 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T01:59:59.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.335+0000 7f83814e0700 10 mgrc shutdown 2023-09-30T01:59:59.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.335+0000 7f83814e0700 1 -- 172.21.15.55:0/1862975493 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f836808e8b0 msgr2=0x7f8368090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:59.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.335+0000 7f83814e0700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f836808e8b0 0x7f8368090d60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f836c0013f0 tx=0x7f836c009040 comp rx=0 tx=0).stop 2023-09-30T01:59:59.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.335+0000 7f83814e0700 1 -- 172.21.15.55:0/1862975493 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f837c13a400 msgr2=0x7f837c1548b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T01:59:59.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.335+0000 7f83814e0700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f837c13a400 0x7f837c1548b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8370013000 tx=0x7f8370016000 comp rx=0 tx=0).stop 2023-09-30T01:59:59.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.335+0000 7f83814e0700 1 -- 172.21.15.55:0/1862975493 shutdown_connections 2023-09-30T01:59:59.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.339+0000 7f83814e0700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f837c147860 0x7f837c1423a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:59.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.339+0000 7f83814e0700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f836808e8b0 0x7f8368090d60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:59.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.339+0000 7f83814e0700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f837c13a400 0x7f837c1548b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:59.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.339+0000 7f83814e0700 1 --2- 172.21.15.55:0/1862975493 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f837c0b3b60 0x7f837c1439b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T01:59:59.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.339+0000 7f83814e0700 1 -- 172.21.15.55:0/1862975493 >> 172.21.15.55:0/1862975493 conn(0x7f837c062e20 msgr2=0x7f837c06ecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T01:59:59.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.339+0000 7f83814e0700 1 -- 172.21.15.55:0/1862975493 shutdown_connections 2023-09-30T01:59:59.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T01:59:59.339+0000 7f83814e0700 1 -- 172.21.15.55:0/1862975493 wait complete. 2023-09-30T01:59:59.999 INFO:tasks.ceph.mon.a.smithi055.stderr:2023-09-30T01:59:59.999+0000 7f5680154700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale' 2023-09-30T02:00:02.355 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:02.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.463+0000 7fdfc4959700 1 Processor -- start 2023-09-30T02:00:02.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.463+0000 7fdfc4959700 1 -- start start 2023-09-30T02:00:02.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.463+0000 7fdfc4959700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fdfc013a750 0x7fdfc00aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:02.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.463+0000 7fdfc4959700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc00af120 con 0x7fdfc00a4990 2023-09-30T02:00:02.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.463+0000 7fdfc4959700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfc00af5b0 con 0x7fdfc00a4d60 2023-09-30T02:00:02.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.463+0000 7fdfc4959700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfc009fb10 con 0x7fdfc013a750 2023-09-30T02:00:02.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.463+0000 7fdfbed9d700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fdfc00a4990 0x7fdfc00a1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41856/0 (socket says 172.21.15.55:41856) 2023-09-30T02:00:02.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.463+0000 7fdfbed9d700 1 -- 172.21.15.55:0/1501159864 learned_addr learned my addr 172.21.15.55:0/1501159864 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T02:00:02.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.463+0000 7fdfbf59e700 1 --2- 172.21.15.55:0/1501159864 >> v2:172.21.15.55:3300/0 conn(0x7fdfc013a750 0x7fdfc00aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:02.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.463+0000 7fdfbdd9b700 1 -- 172.21.15.55:0/1501159864 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2334835989 0 0) 0x7fdfc00af120 con 0x7fdfc00a4990 2023-09-30T02:00:02.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.463+0000 7fdfbdd9b700 1 -- 172.21.15.55:0/1501159864 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdfac003570 con 0x7fdfc00a4990 2023-09-30T02:00:02.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfbdd9b700 1 -- 172.21.15.55:0/1501159864 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3354632928 0 0) 0x7fdfc00af5b0 con 0x7fdfc00a4d60 2023-09-30T02:00:02.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfbf59e700 1 -- 172.21.15.55:0/1501159864 >> v1:172.21.15.133:6789/0 conn(0x7fdfc00a4d60 legacy=0x7fdfc014ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:02.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfbf59e700 1 -- 172.21.15.55:0/1501159864 >> v1:172.21.15.55:6789/0 conn(0x7fdfc00a4990 legacy=0x7fdfc00a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:02.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfbf59e700 1 -- 172.21.15.55:0/1501159864 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc009fdd0 con 0x7fdfc013a750 2023-09-30T02:00:02.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfbf59e700 1 --2- 172.21.15.55:0/1501159864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfc013a750 0x7fdfc00aeb90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00098e0 tx=0x7fdfb00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9859c0eff7d94d3 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:02.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfbdd9b700 1 -- 172.21.15.55:0/1501159864 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb80017f0 con 0x7fdfc013a750 2023-09-30T02:00:02.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfbdd9b700 1 -- 172.21.15.55:0/1501159864 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb0011420 con 0x7fdfc013a750 2023-09-30T02:00:02.471 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfbdd9b700 1 -- 172.21.15.55:0/1501159864 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb00117c0 con 0x7fdfc013a750 2023-09-30T02:00:02.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 -- 172.21.15.55:0/1501159864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfc013a750 msgr2=0x7fdfc00aeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:02.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 --2- 172.21.15.55:0/1501159864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfc013a750 0x7fdfc00aeb90 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fdfb00098e0 tx=0x7fdfb00091a0 comp rx=0 tx=0).stop 2023-09-30T02:00:02.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 -- 172.21.15.55:0/1501159864 shutdown_connections 2023-09-30T02:00:02.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 --2- 172.21.15.55:0/1501159864 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfc013a750 0x7fdfc00aeb90 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:02.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 -- 172.21.15.55:0/1501159864 >> 172.21.15.55:0/1501159864 conn(0x7fdfc00b23d0 msgr2=0x7fdfc00b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:02.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 -- 172.21.15.55:0/1501159864 shutdown_connections 2023-09-30T02:00:02.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 -- 172.21.15.55:0/1501159864 wait complete. 2023-09-30T02:00:02.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 Processor -- start 2023-09-30T02:00:02.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 -- start start 2023-09-30T02:00:02.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfc00a4990 0x7fdfc0147a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:02.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdfc00a4d60 0x7fdfc0095f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:02.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc013a750 0x7fdfc0138ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:02.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0139a30 con 0x7fdfc00a4990 2023-09-30T02:00:02.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0137b90 con 0x7fdfc013a750 2023-09-30T02:00:02.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfc4959700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfc0139770 con 0x7fdfc00a4d60 2023-09-30T02:00:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfbed9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfc00a4990 0x7fdfc0147a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfbe59c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdfc00a4d60 0x7fdfc0095f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.467+0000 7fdfbed9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfc00a4990 0x7fdfc0147a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:50172/0 (socket says 172.21.15.55:50172) 2023-09-30T02:00:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfbed9d700 1 -- 172.21.15.55:0/345700655 learned_addr learned my addr 172.21.15.55:0/345700655 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfbf59e700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc013a750 0x7fdfc0138ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfbed9d700 1 -- 172.21.15.55:0/345700655 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdfc00a4d60 msgr2=0x7fdfc0095f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfbed9d700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdfc00a4d60 0x7fdfc0095f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfbed9d700 1 -- 172.21.15.55:0/345700655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc013a750 msgr2=0x7fdfc0138ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfbed9d700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc013a750 0x7fdfc0138ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfbed9d700 1 -- 172.21.15.55:0/345700655 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfb0009420 con 0x7fdfc00a4990 2023-09-30T02:00:02.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfbf59e700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc013a750 0x7fdfc0138ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T02:00:02.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfbe59c700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdfc00a4d60 0x7fdfc0095f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T02:00:02.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfbed9d700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfc00a4990 0x7fdfc0147a10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8001560 tx=0x7fdfb8007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:02.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfb6ffd700 1 -- 172.21.15.55:0/345700655 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb8004e20 con 0x7fdfc00a4990 2023-09-30T02:00:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfb6ffd700 1 -- 172.21.15.55:0/345700655 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfb800a780 con 0x7fdfc00a4990 2023-09-30T02:00:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfc4959700 1 -- 172.21.15.55:0/345700655 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc0138580 con 0x7fdfc00a4990 2023-09-30T02:00:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfb6ffd700 1 -- 172.21.15.55:0/345700655 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfb800ab40 con 0x7fdfc00a4990 2023-09-30T02:00:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfc4959700 1 -- 172.21.15.55:0/345700655 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfc0139020 con 0x7fdfc00a4990 2023-09-30T02:00:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.471+0000 7fdfb4ff9700 1 -- 172.21.15.55:0/345700655 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf980050b0 con 0x7fdfc00a4990 2023-09-30T02:00:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.475+0000 7fdfb6ffd700 1 -- 172.21.15.55:0/345700655 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fdfb8007150 con 0x7fdfc00a4990 2023-09-30T02:00:02.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.475+0000 7fdfb6ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.475+0000 7fdfb6ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.475+0000 7fdfb6ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:02.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.475+0000 7fdfb6ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:02.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.475+0000 7fdfb6ffd700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdfa008e8b0 0x7fdfa0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:02.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.475+0000 7fdfb6ffd700 1 -- 172.21.15.55:0/345700655 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fdfb80b42d0 con 0x7fdfc00a4990 2023-09-30T02:00:02.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.475+0000 7fdfbe59c700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdfa008e8b0 0x7fdfa0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:02.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.475+0000 7fdfbe59c700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdfa008e8b0 0x7fdfa0090d60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8007fd0 tx=0x7fdfa8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:02.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.483+0000 7fdfb6ffd700 1 -- 172.21.15.55:0/345700655 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fdfb8084d00 con 0x7fdfc00a4990 2023-09-30T02:00:02.686 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.683+0000 7fdfb4ff9700 1 -- 172.21.15.55:0/345700655 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fdf98005360 con 0x7fdfc00a4990 2023-09-30T02:00:02.687 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.683+0000 7fdfb6ffd700 1 -- 172.21.15.55:0/345700655 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fdfb8018100 con 0x7fdfc00a4990 2023-09-30T02:00:02.687 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:02.687 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:02.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.683+0000 7fdfb4ff9700 10 mgrc shutdown 2023-09-30T02:00:02.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.687+0000 7fdfb4ff9700 1 -- 172.21.15.55:0/345700655 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdfa008e8b0 msgr2=0x7fdfa0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:02.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.687+0000 7fdfb4ff9700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdfa008e8b0 0x7fdfa0090d60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8007fd0 tx=0x7fdfa8009040 comp rx=0 tx=0).stop 2023-09-30T02:00:02.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.687+0000 7fdfb4ff9700 1 -- 172.21.15.55:0/345700655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfc00a4990 msgr2=0x7fdfc0147a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:02.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.687+0000 7fdfb4ff9700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfc00a4990 0x7fdfc0147a10 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fdfb8001560 tx=0x7fdfb8007e90 comp rx=0 tx=0).stop 2023-09-30T02:00:02.690 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.687+0000 7fdfb4ff9700 1 -- 172.21.15.55:0/345700655 shutdown_connections 2023-09-30T02:00:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.687+0000 7fdfb4ff9700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fdfc013a750 0x7fdfc0138ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.687+0000 7fdfb4ff9700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fdfa008e8b0 0x7fdfa0090d60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.687+0000 7fdfb4ff9700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fdfc00a4d60 0x7fdfc0095f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.687+0000 7fdfb4ff9700 1 --2- 172.21.15.55:0/345700655 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fdfc00a4990 0x7fdfc0147a10 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.687+0000 7fdfb4ff9700 1 -- 172.21.15.55:0/345700655 >> 172.21.15.55:0/345700655 conn(0x7fdfc00b23d0 msgr2=0x7fdfc009f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.687+0000 7fdfb4ff9700 1 -- 172.21.15.55:0/345700655 shutdown_connections 2023-09-30T02:00:02.691 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:02.687+0000 7fdfb4ff9700 1 -- 172.21.15.55:0/345700655 wait complete. 2023-09-30T02:00:05.702 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:05.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7dfb59e700 1 Processor -- start 2023-09-30T02:00:05.818 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7dfb59e700 1 -- start start 2023-09-30T02:00:05.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7dfb59e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7dfc06c2d0 0x7f7dfc13fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:05.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7dfb59e700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dfc1409e0 con 0x7f7dfc13d490 2023-09-30T02:00:05.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7dfb59e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dfc140ca0 con 0x7f7dfc140400 2023-09-30T02:00:05.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7dfb59e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc06ccb0 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.821 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7df9d9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7dfc06c2d0 0x7f7dfc13fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:05.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7df9d9b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7dfc06c2d0 0x7f7dfc13fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:34358/0 (socket says 172.21.15.55:34358) 2023-09-30T02:00:05.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7df9d9b700 1 -- 172.21.15.55:0/548130131 learned_addr learned my addr 172.21.15.55:0/548130131 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:05.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7df9d9b700 1 -- 172.21.15.55:0/548130131 >> v1:172.21.15.133:6789/0 conn(0x7f7dfc140400 legacy=0x7f7dfc14a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:05.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7df959a700 1 -- 172.21.15.55:0/548130131 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2880658553 0 0) 0x7f7dfc1409e0 con 0x7f7dfc13d490 2023-09-30T02:00:05.822 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7df9d9b700 1 -- 172.21.15.55:0/548130131 >> v1:172.21.15.55:6789/0 conn(0x7f7dfc13d490 legacy=0x7f7dfc06ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:05.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7df9d9b700 1 -- 172.21.15.55:0/548130131 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dfc13d860 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7df9d9b700 1 --2- 172.21.15.55:0/548130131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7dfc06c2d0 0x7f7dfc13fec0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009f50 tx=0x7f7df0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=40377c8874c4dfc7 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:05.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7df959a700 1 -- 172.21.15.55:0/548130131 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df000e070 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7df959a700 1 -- 172.21.15.55:0/548130131 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df000bab0 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.823 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.815+0000 7f7df959a700 1 -- 172.21.15.55:0/548130131 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df00092e0 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 -- 172.21.15.55:0/548130131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7dfc06c2d0 msgr2=0x7f7dfc13fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:05.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 --2- 172.21.15.55:0/548130131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7dfc06c2d0 0x7f7dfc13fec0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009f50 tx=0x7f7df0009840 comp rx=0 tx=0).stop 2023-09-30T02:00:05.826 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 -- 172.21.15.55:0/548130131 shutdown_connections 2023-09-30T02:00:05.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 --2- 172.21.15.55:0/548130131 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7dfc06c2d0 0x7f7dfc13fec0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:05.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 -- 172.21.15.55:0/548130131 >> 172.21.15.55:0/548130131 conn(0x7f7dfc0b2cf0 msgr2=0x7f7dfc0b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:05.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 -- 172.21.15.55:0/548130131 shutdown_connections 2023-09-30T02:00:05.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 -- 172.21.15.55:0/548130131 wait complete. 2023-09-30T02:00:05.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 Processor -- start 2023-09-30T02:00:05.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 -- start start 2023-09-30T02:00:05.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7dfc06c2d0 0x7f7dfc0ae500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:05.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dfc13d490 0x7f7dfc14fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:05.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dfc140400 0x7f7dfc0abad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:05.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc0af0f0 con 0x7f7dfc140400 2023-09-30T02:00:05.827 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc150970 con 0x7f7dfc13d490 2023-09-30T02:00:05.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfb59e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dfc150c30 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfa59c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7dfc06c2d0 0x7f7dfc0ae500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:05.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfa59c700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7dfc06c2d0 0x7f7dfc0ae500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:34372/0 (socket says 172.21.15.55:34372) 2023-09-30T02:00:05.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfa59c700 1 -- 172.21.15.55:0/1466747552 learned_addr learned my addr 172.21.15.55:0/1466747552 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:05.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfad9d700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dfc140400 0x7f7dfc0abad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:05.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7df9d9b700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dfc13d490 0x7f7dfc14fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:05.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfa59c700 1 -- 172.21.15.55:0/1466747552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dfc13d490 msgr2=0x7f7dfc14fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:05.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfa59c700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dfc13d490 0x7f7dfc14fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:05.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfa59c700 1 -- 172.21.15.55:0/1466747552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dfc140400 msgr2=0x7f7dfc0abad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:05.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfa59c700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dfc140400 0x7f7dfc0abad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:05.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7dfa59c700 1 -- 172.21.15.55:0/1466747552 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7df0009ae0 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.819+0000 7f7df9d9b700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dfc13d490 0x7f7dfc14fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T02:00:05.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.823+0000 7f7dfa59c700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7dfc06c2d0 0x7f7dfc0ae500 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00c5e0 tx=0x7f7dec007d20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:05.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.823+0000 7f7dea7fc700 1 -- 172.21.15.55:0/1466747552 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec00e4a0 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.823+0000 7f7dea7fc700 1 -- 172.21.15.55:0/1466747552 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dec00e600 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.823+0000 7f7dea7fc700 1 -- 172.21.15.55:0/1466747552 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dec00e9c0 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.823+0000 7f7dfb59e700 1 -- 172.21.15.55:0/1466747552 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dfc13bf40 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.823+0000 7f7dfb59e700 1 -- 172.21.15.55:0/1466747552 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dfc13c660 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.823+0000 7f7dfb59e700 1 -- 172.21.15.55:0/1466747552 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dfc13c2e0 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.823+0000 7f7dea7fc700 1 -- 172.21.15.55:0/1466747552 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f7dec01b3b0 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.823+0000 7f7dea7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:05.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.827+0000 7f7dea7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:05.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.827+0000 7f7dea7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:05.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.827+0000 7f7dea7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:05.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.827+0000 7f7dea7fc700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7ddc08e8b0 0x7f7ddc090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:05.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.827+0000 7f7df9d9b700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7ddc08e8b0 0x7f7ddc090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:05.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.827+0000 7f7dea7fc700 1 -- 172.21.15.55:0/1466747552 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f7dec0b4310 con 0x7f7dfc06c2d0 2023-09-30T02:00:05.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.827+0000 7f7df9d9b700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7ddc08e8b0 0x7f7ddc090d60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009ea0 tx=0x7f7df0018000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:05.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:05.831+0000 7f7dea7fc700 1 -- 172.21.15.55:0/1466747552 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7dec084c90 con 0x7f7dfc06c2d0 2023-09-30T02:00:06.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.023+0000 7f7dfb59e700 1 -- 172.21.15.55:0/1466747552 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7dfc064440 con 0x7f7dfc06c2d0 2023-09-30T02:00:06.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.023+0000 7f7dea7fc700 1 -- 172.21.15.55:0/1466747552 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f7dec017070 con 0x7f7dfc06c2d0 2023-09-30T02:00:06.029 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:06.029 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:06.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.027+0000 7f7dfb59e700 10 mgrc shutdown 2023-09-30T02:00:06.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.027+0000 7f7dfb59e700 1 -- 172.21.15.55:0/1466747552 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7ddc08e8b0 msgr2=0x7f7ddc090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:06.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.027+0000 7f7dfb59e700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7ddc08e8b0 0x7f7ddc090d60 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f7df0009ea0 tx=0x7f7df0018000 comp rx=0 tx=0).stop 2023-09-30T02:00:06.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.027+0000 7f7dfb59e700 1 -- 172.21.15.55:0/1466747552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7dfc06c2d0 msgr2=0x7f7dfc0ae500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:06.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.027+0000 7f7dfb59e700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7dfc06c2d0 0x7f7dfc0ae500 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7dec00c5e0 tx=0x7f7dec007d20 comp rx=0 tx=0).stop 2023-09-30T02:00:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.027+0000 7f7dfb59e700 1 -- 172.21.15.55:0/1466747552 shutdown_connections 2023-09-30T02:00:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.027+0000 7f7dfb59e700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f7dfc140400 0x7f7dfc0abad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.027+0000 7f7dfb59e700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f7dfc13d490 0x7f7dfc14fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.027+0000 7f7dfb59e700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f7ddc08e8b0 0x7f7ddc090d60 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.027+0000 7f7dfb59e700 1 --2- 172.21.15.55:0/1466747552 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f7dfc06c2d0 0x7f7dfc0ae500 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.027+0000 7f7dfb59e700 1 -- 172.21.15.55:0/1466747552 >> 172.21.15.55:0/1466747552 conn(0x7f7dfc0b2cf0 msgr2=0x7f7dfc06edd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.027+0000 7f7dfb59e700 1 -- 172.21.15.55:0/1466747552 shutdown_connections 2023-09-30T02:00:06.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:06.027+0000 7f7dfb59e700 1 -- 172.21.15.55:0/1466747552 wait complete. 2023-09-30T02:00:09.044 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:09.158 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55f5d1b700 1 Processor -- start 2023-09-30T02:00:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55f5d1b700 1 -- start start 2023-09-30T02:00:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55f5d1b700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f55f00b3c20 0x7f55f0135e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:09.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55f5d1b700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f00b3ff0 con 0x7f55f00ab920 2023-09-30T02:00:09.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55f5d1b700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f01440a0 con 0x7f55f0143b20 2023-09-30T02:00:09.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55f5d1b700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f00a6cf0 con 0x7f55f00b3c20 2023-09-30T02:00:09.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55effff700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f55f00ab920 0x7f55f0143410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:41876/0 (socket says 172.21.15.55:41876) 2023-09-30T02:00:09.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55effff700 1 -- 172.21.15.55:0/4056351759 learned_addr learned my addr 172.21.15.55:0/4056351759 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T02:00:09.160 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55f4d19700 1 --2- 172.21.15.55:0/4056351759 >> v2:172.21.15.133:3300/0 conn(0x7f55f00b3c20 0x7f55f0135e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:09.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1525370948 0 0) 0x7f55f00b3ff0 con 0x7f55f00ab920 2023-09-30T02:00:09.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55d8003570 con 0x7f55f00ab920 2023-09-30T02:00:09.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698850145 0 0) 0x7f55f01440a0 con 0x7f55f0143b20 2023-09-30T02:00:09.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f00b3ff0 con 0x7f55f0143b20 2023-09-30T02:00:09.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1944651564 0 0) 0x7f55d8003570 con 0x7f55f00ab920 2023-09-30T02:00:09.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 >> v2:172.21.15.133:3300/0 conn(0x7f55f00b3c20 msgr2=0x7f55f0135e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:09.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 --2- 172.21.15.55:0/4056351759 >> v2:172.21.15.133:3300/0 conn(0x7f55f00b3c20 0x7f55f0135e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:09.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 >> v1:172.21.15.133:6789/0 conn(0x7f55f0143b20 legacy=0x7f55f00a4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:09.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 --> v1:172.21.15.55:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0136360 con 0x7f55f00ab920 2023-09-30T02:00:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 <== mon.0 v1:172.21.15.55:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 254224620 0 0) 0x7f55e0001470 con 0x7f55f00ab920 2023-09-30T02:00:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 >> v1:172.21.15.55:6789/0 conn(0x7f55f00ab920 legacy=0x7f55f0143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 --2- 172.21.15.55:0/4056351759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55d8003bf0 0x7f55d8003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 --2- 172.21.15.55:0/4056351759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55d8004810 0x7f55d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 --2- 172.21.15.55:0/4056351759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d80051c0 0x7f55d800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f00a6cf0 con 0x7f55d8004810 2023-09-30T02:00:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d800c0b0 con 0x7f55d80051c0 2023-09-30T02:00:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55d800c270 con 0x7f55d8003bf0 2023-09-30T02:00:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55f4d19700 1 --2- 172.21.15.55:0/4056351759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55d8003bf0 0x7f55d8003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55effff700 1 --2- 172.21.15.55:0/4056351759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55d8004810 0x7f55d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.155+0000 7f55f551a700 1 --2- 172.21.15.55:0/4056351759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d80051c0 0x7f55d800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:09.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55effff700 1 -- 172.21.15.55:0/4056351759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55d8003bf0 msgr2=0x7f55d8003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55effff700 1 --2- 172.21.15.55:0/4056351759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55d8003bf0 0x7f55d8003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55effff700 1 -- 172.21.15.55:0/4056351759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d80051c0 msgr2=0x7f55d800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55effff700 1 --2- 172.21.15.55:0/4056351759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d80051c0 0x7f55d800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55effff700 1 -- 172.21.15.55:0/4056351759 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d8003570 con 0x7f55d8004810 2023-09-30T02:00:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55f551a700 1 --2- 172.21.15.55:0/4056351759 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55d80051c0 0x7f55d800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T02:00:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55f551a700 1 -- 172.21.15.55:0/4056351759 reap_dead start 2023-09-30T02:00:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55f4d19700 1 --2- 172.21.15.55:0/4056351759 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55d8003bf0 0x7f55d8003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T02:00:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55effff700 1 --2- 172.21.15.55:0/4056351759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55d8004810 0x7f55d8004c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f55e000c2d0 tx=0x7f55e0001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b5be4c36ea18f52 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e000cba0 con 0x7f55d8004810 2023-09-30T02:00:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e000cd00 con 0x7f55d8004810 2023-09-30T02:00:09.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55ef7fe700 1 -- 172.21.15.55:0/4056351759 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e0005b70 con 0x7f55d8004810 2023-09-30T02:00:09.166 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4056351759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55d8004810 msgr2=0x7f55d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55f5d1b700 1 --2- 172.21.15.55:0/4056351759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55d8004810 0x7f55d8004c80 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f55e000c2d0 tx=0x7f55e0001e10 comp rx=0 tx=0).stop 2023-09-30T02:00:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4056351759 shutdown_connections 2023-09-30T02:00:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55f5d1b700 1 --2- 172.21.15.55:0/4056351759 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55d8004810 0x7f55d8004c80 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4056351759 >> 172.21.15.55:0/4056351759 conn(0x7f55f0062e20 msgr2=0x7f55f0063220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4056351759 shutdown_connections 2023-09-30T02:00:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4056351759 wait complete. 2023-09-30T02:00:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55f5d1b700 1 Processor -- start 2023-09-30T02:00:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.159+0000 7f55f5d1b700 1 -- start start 2023-09-30T02:00:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f5d1b700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55d8004810 0x7f55f014ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f5d1b700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f0150ce0 0x7f55f0136b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f5d1b700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f00af9f0 0x7f55f0137d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:09.167 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f5d1b700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0137050 con 0x7f55f00af9f0 2023-09-30T02:00:09.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f5d1b700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f01505d0 con 0x7f55f0150ce0 2023-09-30T02:00:09.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f5d1b700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f0150890 con 0x7f55d8004810 2023-09-30T02:00:09.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f551a700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f00af9f0 0x7f55f0137d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:09.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f4d19700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55d8004810 0x7f55f014ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:09.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f4d19700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55d8004810 0x7f55f014ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:34396/0 (socket says 172.21.15.55:34396) 2023-09-30T02:00:09.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f4d19700 1 -- 172.21.15.55:0/4048119566 learned_addr learned my addr 172.21.15.55:0/4048119566 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:09.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55effff700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f0150ce0 0x7f55f0136b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:09.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f551a700 1 -- 172.21.15.55:0/4048119566 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55d8004810 msgr2=0x7f55f014ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:09.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f551a700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55d8004810 0x7f55f014ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:09.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f551a700 1 -- 172.21.15.55:0/4048119566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f0150ce0 msgr2=0x7f55f0136b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:09.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f551a700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f0150ce0 0x7f55f0136b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:09.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f551a700 1 -- 172.21.15.55:0/4048119566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f01510f0 con 0x7f55f00af9f0 2023-09-30T02:00:09.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f4d19700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55d8004810 0x7f55f014ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T02:00:09.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55effff700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f0150ce0 0x7f55f0136b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T02:00:09.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f551a700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f00af9f0 0x7f55f0137d70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f55f00b3350 tx=0x7f55e8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55ecff9700 1 -- 172.21.15.55:0/4048119566 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e8017070 con 0x7f55f00af9f0 2023-09-30T02:00:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55ecff9700 1 -- 172.21.15.55:0/4048119566 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55e80032e0 con 0x7f55f00af9f0 2023-09-30T02:00:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4048119566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f00a62e0 con 0x7f55f00af9f0 2023-09-30T02:00:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55ecff9700 1 -- 172.21.15.55:0/4048119566 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55e8006ba0 con 0x7f55f00af9f0 2023-09-30T02:00:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4048119566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f00b08d0 con 0x7f55f00af9f0 2023-09-30T02:00:09.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.163+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4048119566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f00ac2b0 con 0x7f55f00af9f0 2023-09-30T02:00:09.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.167+0000 7f55ecff9700 1 -- 172.21.15.55:0/4048119566 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f55e80016e0 con 0x7f55f00af9f0 2023-09-30T02:00:09.172 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.167+0000 7f55ecff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:09.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.167+0000 7f55ecff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:09.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.167+0000 7f55ecff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:09.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.167+0000 7f55ecff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:09.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.171+0000 7f55ecff9700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f55dc08e8e0 0x7f55dc090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:09.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.171+0000 7f55f4d19700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f55dc08e8e0 0x7f55dc090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:09.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.171+0000 7f55ecff9700 1 -- 172.21.15.55:0/4048119566 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f55e80b4bb0 con 0x7f55f00af9f0 2023-09-30T02:00:09.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.171+0000 7f55f4d19700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f55dc08e8e0 0x7f55dc090d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f55e4009710 tx=0x7f55e4009120 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:09.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.175+0000 7f55ecff9700 1 -- 172.21.15.55:0/4048119566 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f55e8088fe0 con 0x7f55f00af9f0 2023-09-30T02:00:09.373 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4048119566 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f55f00ac2b0 con 0x7f55f00af9f0 2023-09-30T02:00:09.374 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55ecff9700 1 -- 172.21.15.55:0/4048119566 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f55f00ac2b0 con 0x7f55f00af9f0 2023-09-30T02:00:09.374 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:09.374 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:09.376 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55f5d1b700 10 mgrc shutdown 2023-09-30T02:00:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4048119566 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f55dc08e8e0 msgr2=0x7f55dc090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55f5d1b700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f55dc08e8e0 0x7f55dc090d90 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f55e4009710 tx=0x7f55e4009120 comp rx=0 tx=0).stop 2023-09-30T02:00:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4048119566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f00af9f0 msgr2=0x7f55f0137d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55f5d1b700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f00af9f0 0x7f55f0137d70 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f55f00b3350 tx=0x7f55e8009040 comp rx=0 tx=0).stop 2023-09-30T02:00:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4048119566 shutdown_connections 2023-09-30T02:00:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55f5d1b700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f55f00af9f0 0x7f55f0137d70 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55f5d1b700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f55f0150ce0 0x7f55f0136b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55f5d1b700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f55dc08e8e0 0x7f55dc090d90 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55f5d1b700 1 --2- 172.21.15.55:0/4048119566 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f55d8004810 0x7f55f014ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:09.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4048119566 >> 172.21.15.55:0/4048119566 conn(0x7f55f0062e20 msgr2=0x7f55f006c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:09.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4048119566 shutdown_connections 2023-09-30T02:00:09.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:09.371+0000 7f55f5d1b700 1 -- 172.21.15.55:0/4048119566 wait complete. 2023-09-30T02:00:12.390 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:12.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.499+0000 7fbc72de3700 1 Processor -- start 2023-09-30T02:00:12.504 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.499+0000 7fbc72de3700 1 -- start start 2023-09-30T02:00:12.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.499+0000 7fbc72de3700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbc6c0a4bc0 0x7fbc6c06af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:12.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.499+0000 7fbc72de3700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6c0a1880 con 0x7fbc6c13d770 2023-09-30T02:00:12.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.499+0000 7fbc72de3700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6c0a4f90 con 0x7fbc6c06c360 2023-09-30T02:00:12.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.499+0000 7fbc72de3700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc6c0a1ab0 con 0x7fbc6c0a4bc0 2023-09-30T02:00:12.505 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.499+0000 7fbc725e2700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbc6c13d770 0x7fbc6c1473c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55006/0 (socket says 172.21.15.55:55006) 2023-09-30T02:00:12.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.499+0000 7fbc725e2700 1 -- 172.21.15.55:0/1403798528 learned_addr learned my addr 172.21.15.55:0/1403798528 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T02:00:12.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.499+0000 7fbc71de1700 1 --2- 172.21.15.55:0/1403798528 >> v2:172.21.15.133:3300/0 conn(0x7fbc6c0a4bc0 0x7fbc6c06af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:12.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.499+0000 7fbc70ddf700 1 -- 172.21.15.55:0/1403798528 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1738360437 0 0) 0x7fbc6c0a1880 con 0x7fbc6c13d770 2023-09-30T02:00:12.506 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc70ddf700 1 -- 172.21.15.55:0/1403798528 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbc58003570 con 0x7fbc6c13d770 2023-09-30T02:00:12.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc71de1700 1 -- 172.21.15.55:0/1403798528 >> v1:172.21.15.133:6789/0 conn(0x7fbc6c06c360 legacy=0x7fbc6c13d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:12.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc71de1700 1 -- 172.21.15.55:0/1403798528 >> v1:172.21.15.55:6789/0 conn(0x7fbc6c13d770 legacy=0x7fbc6c1473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:12.507 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc70ddf700 1 -- 172.21.15.55:0/1403798528 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1320050049 0 0) 0x7fbc58003570 con 0x7fbc6c13d770 2023-09-30T02:00:12.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc71de1700 1 -- 172.21.15.55:0/1403798528 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c0a1d70 con 0x7fbc6c0a4bc0 2023-09-30T02:00:12.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc71de1700 1 --2- 172.21.15.55:0/1403798528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc6c0a4bc0 0x7fbc6c06af90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0a1f60 tx=0x7fbc680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e44364eef825365d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:12.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc70ddf700 1 -- 172.21.15.55:0/1403798528 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc640017f0 con 0x7fbc6c0a4bc0 2023-09-30T02:00:12.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc70ddf700 1 -- 172.21.15.55:0/1403798528 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc68011420 con 0x7fbc6c0a4bc0 2023-09-30T02:00:12.508 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc70ddf700 1 -- 172.21.15.55:0/1403798528 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc680117a0 con 0x7fbc6c0a4bc0 2023-09-30T02:00:12.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc72de3700 1 -- 172.21.15.55:0/1403798528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc6c0a4bc0 msgr2=0x7fbc6c06af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:12.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc72de3700 1 --2- 172.21.15.55:0/1403798528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc6c0a4bc0 0x7fbc6c06af90 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c0a1f60 tx=0x7fbc680091a0 comp rx=0 tx=0).stop 2023-09-30T02:00:12.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc72de3700 1 -- 172.21.15.55:0/1403798528 shutdown_connections 2023-09-30T02:00:12.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc72de3700 1 --2- 172.21.15.55:0/1403798528 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc6c0a4bc0 0x7fbc6c06af90 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:12.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc72de3700 1 -- 172.21.15.55:0/1403798528 >> 172.21.15.55:0/1403798528 conn(0x7fbc6c0b23d0 msgr2=0x7fbc6c0b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:12.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc72de3700 1 -- 172.21.15.55:0/1403798528 shutdown_connections 2023-09-30T02:00:12.509 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.503+0000 7fbc72de3700 1 -- 172.21.15.55:0/1403798528 wait complete. 2023-09-30T02:00:12.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.507+0000 7fbc72de3700 1 Processor -- start 2023-09-30T02:00:12.510 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.507+0000 7fbc72de3700 1 -- start start 2023-09-30T02:00:12.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.507+0000 7fbc72de3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc6c06c360 0x7fbc6c09f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:12.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.507+0000 7fbc72de3700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc6c0a4bc0 0x7fbc6c09cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:12.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.507+0000 7fbc72de3700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc6c13d770 0x7fbc6c151210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:12.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.507+0000 7fbc72de3700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c150e20 con 0x7fbc6c06c360 2023-09-30T02:00:12.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.507+0000 7fbc72de3700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c1442e0 con 0x7fbc6c13d770 2023-09-30T02:00:12.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.507+0000 7fbc72de3700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc6c09d0c0 con 0x7fbc6c0a4bc0 2023-09-30T02:00:12.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.507+0000 7fbc71de1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc6c06c360 0x7fbc6c09f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:12.513 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.507+0000 7fbc715e0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc6c0a4bc0 0x7fbc6c09cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:12.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.507+0000 7fbc71de1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc6c06c360 0x7fbc6c09f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43090/0 (socket says 172.21.15.55:43090) 2023-09-30T02:00:12.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.507+0000 7fbc715e0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc6c0a4bc0 0x7fbc6c09cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:47968/0 (socket says 172.21.15.55:47968) 2023-09-30T02:00:12.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.507+0000 7fbc71de1700 1 -- 172.21.15.55:0/3200395219 learned_addr learned my addr 172.21.15.55:0/3200395219 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:12.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.507+0000 7fbc725e2700 1 --2- 172.21.15.55:0/3200395219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc6c13d770 0x7fbc6c151210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:12.514 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.511+0000 7fbc71de1700 1 -- 172.21.15.55:0/3200395219 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc6c0a4bc0 msgr2=0x7fbc6c09cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:12.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.511+0000 7fbc71de1700 1 --2- 172.21.15.55:0/3200395219 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc6c0a4bc0 0x7fbc6c09cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:12.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.511+0000 7fbc71de1700 1 -- 172.21.15.55:0/3200395219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc6c13d770 msgr2=0x7fbc6c151210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:12.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.511+0000 7fbc71de1700 1 --2- 172.21.15.55:0/3200395219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc6c13d770 0x7fbc6c151210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:12.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.511+0000 7fbc71de1700 1 -- 172.21.15.55:0/3200395219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc68009420 con 0x7fbc6c06c360 2023-09-30T02:00:12.515 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.511+0000 7fbc71de1700 1 --2- 172.21.15.55:0/3200395219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc6c06c360 0x7fbc6c09f6d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc680091e0 tx=0x7fbc68016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:12.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.511+0000 7fbc61ffb700 1 -- 172.21.15.55:0/3200395219 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6801cc00 con 0x7fbc6c06c360 2023-09-30T02:00:12.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.511+0000 7fbc61ffb700 1 -- 172.21.15.55:0/3200395219 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6801cd60 con 0x7fbc6c06c360 2023-09-30T02:00:12.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.511+0000 7fbc72de3700 1 -- 172.21.15.55:0/3200395219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc6c09be80 con 0x7fbc6c06c360 2023-09-30T02:00:12.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.511+0000 7fbc61ffb700 1 -- 172.21.15.55:0/3200395219 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc6801a680 con 0x7fbc6c06c360 2023-09-30T02:00:12.516 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.511+0000 7fbc72de3700 1 -- 172.21.15.55:0/3200395219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6c151750 con 0x7fbc6c06c360 2023-09-30T02:00:12.517 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.515+0000 7fbc72de3700 1 -- 172.21.15.55:0/3200395219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc6c064440 con 0x7fbc6c06c360 2023-09-30T02:00:12.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.515+0000 7fbc61ffb700 1 -- 172.21.15.55:0/3200395219 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fbc6801aa70 con 0x7fbc6c06c360 2023-09-30T02:00:12.518 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.515+0000 7fbc61ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:12.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.515+0000 7fbc61ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:12.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.515+0000 7fbc61ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:12.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.515+0000 7fbc61ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:12.519 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.515+0000 7fbc61ffb700 1 --2- 172.21.15.55:0/3200395219 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbc5008e9b0 0x7fbc50090e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:12.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.515+0000 7fbc715e0700 1 --2- 172.21.15.55:0/3200395219 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbc5008e9b0 0x7fbc50090e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:12.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.515+0000 7fbc61ffb700 1 -- 172.21.15.55:0/3200395219 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fbc680b5f90 con 0x7fbc6c06c360 2023-09-30T02:00:12.520 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.515+0000 7fbc715e0700 1 --2- 172.21.15.55:0/3200395219 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbc5008e9b0 0x7fbc50090e60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c09fe40 tx=0x7fbc5c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:12.528 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.523+0000 7fbc61ffb700 1 -- 172.21.15.55:0/3200395219 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbc6805abe0 con 0x7fbc6c06c360 2023-09-30T02:00:12.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.723+0000 7fbc72de3700 1 -- 172.21.15.55:0/3200395219 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbc6c0a56a0 con 0x7fbc6c06c360 2023-09-30T02:00:12.727 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.723+0000 7fbc61ffb700 1 -- 172.21.15.55:0/3200395219 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fbc680869c0 con 0x7fbc6c06c360 2023-09-30T02:00:12.727 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:12.727 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:12.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.723+0000 7fbc72de3700 10 mgrc shutdown 2023-09-30T02:00:12.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.723+0000 7fbc72de3700 1 -- 172.21.15.55:0/3200395219 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbc5008e9b0 msgr2=0x7fbc50090e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:12.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.723+0000 7fbc72de3700 1 --2- 172.21.15.55:0/3200395219 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbc5008e9b0 0x7fbc50090e60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fbc6c09fe40 tx=0x7fbc5c009040 comp rx=0 tx=0).stop 2023-09-30T02:00:12.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.723+0000 7fbc72de3700 1 -- 172.21.15.55:0/3200395219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc6c06c360 msgr2=0x7fbc6c09f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.723+0000 7fbc72de3700 1 --2- 172.21.15.55:0/3200395219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc6c06c360 0x7fbc6c09f6d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fbc680091e0 tx=0x7fbc68016000 comp rx=0 tx=0).stop 2023-09-30T02:00:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.723+0000 7fbc72de3700 1 -- 172.21.15.55:0/3200395219 shutdown_connections 2023-09-30T02:00:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.723+0000 7fbc72de3700 1 --2- 172.21.15.55:0/3200395219 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbc6c13d770 0x7fbc6c151210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.723+0000 7fbc72de3700 1 --2- 172.21.15.55:0/3200395219 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbc5008e9b0 0x7fbc50090e60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.723+0000 7fbc72de3700 1 --2- 172.21.15.55:0/3200395219 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbc6c0a4bc0 0x7fbc6c09cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.723+0000 7fbc72de3700 1 --2- 172.21.15.55:0/3200395219 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbc6c06c360 0x7fbc6c09f6d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.723+0000 7fbc72de3700 1 -- 172.21.15.55:0/3200395219 >> 172.21.15.55:0/3200395219 conn(0x7fbc6c0b23d0 msgr2=0x7fbc6c13c330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.727+0000 7fbc72de3700 1 -- 172.21.15.55:0/3200395219 shutdown_connections 2023-09-30T02:00:12.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:12.727+0000 7fbc72de3700 1 -- 172.21.15.55:0/3200395219 wait complete. 2023-09-30T02:00:14.226 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T02:00:14.229 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T02:00:15.741 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afe309700 1 Processor -- start 2023-09-30T02:00:15.859 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afe309700 1 -- start start 2023-09-30T02:00:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afe309700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f5af80682e0 0x7f5af806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afe309700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5af806d080 0x7f5af813ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:15.862 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afe309700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5af813cfc0 0x7f5af80a32a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afe309700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af806b6b0 con 0x7f5af806d080 2023-09-30T02:00:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afe309700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af80a53e0 con 0x7f5af80682e0 2023-09-30T02:00:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afe309700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80686b0 con 0x7f5af813cfc0 2023-09-30T02:00:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afcb06700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5af806d080 0x7f5af813ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afdb08700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5af813cfc0 0x7f5af80a32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afcb06700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f5af806d080 0x7f5af813ca80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43098/0 (socket says 172.21.15.55:43098) 2023-09-30T02:00:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afcb06700 1 -- 172.21.15.55:0/1301027566 learned_addr learned my addr 172.21.15.55:0/1301027566 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afdb08700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5af813cfc0 0x7f5af80a32a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:47980/0 (socket says 172.21.15.55:47980) 2023-09-30T02:00:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afd307700 1 --2- 172.21.15.55:0/1301027566 >> v2:172.21.15.133:3300/0 conn(0x7f5af80682e0 0x7f5af806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afcb06700 1 -- 172.21.15.55:0/1301027566 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5af813cfc0 msgr2=0x7f5af80a32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:15.863 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afcb06700 1 --2- 172.21.15.55:0/1301027566 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5af813cfc0 0x7f5af80a32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afcb06700 1 -- 172.21.15.55:0/1301027566 >> v2:172.21.15.133:3300/0 conn(0x7f5af80682e0 msgr2=0x7f5af806cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afcb06700 1 --2- 172.21.15.55:0/1301027566 >> v2:172.21.15.133:3300/0 conn(0x7f5af80682e0 0x7f5af806cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.855+0000 7f5afcb06700 1 -- 172.21.15.55:0/1301027566 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af80a5610 con 0x7f5af806d080 2023-09-30T02:00:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.859+0000 7f5afcb06700 1 --2- 172.21.15.55:0/1301027566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af806d080 0x7f5af813ca80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5af80b39b0 tx=0x7f5ae8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a9cf5c92325961c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.859+0000 7f5aeffff700 1 -- 172.21.15.55:0/1301027566 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae800b640 con 0x7f5af806d080 2023-09-30T02:00:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.859+0000 7f5aeffff700 1 -- 172.21.15.55:0/1301027566 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae800b7a0 con 0x7f5af806d080 2023-09-30T02:00:15.864 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.859+0000 7f5aeffff700 1 -- 172.21.15.55:0/1301027566 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae800bb40 con 0x7f5af806d080 2023-09-30T02:00:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.859+0000 7f5afe309700 1 -- 172.21.15.55:0/1301027566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af806d080 msgr2=0x7f5af813ca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.859+0000 7f5afe309700 1 --2- 172.21.15.55:0/1301027566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af806d080 0x7f5af813ca80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5af80b39b0 tx=0x7f5ae8009250 comp rx=0 tx=0).stop 2023-09-30T02:00:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.859+0000 7f5afe309700 1 -- 172.21.15.55:0/1301027566 shutdown_connections 2023-09-30T02:00:15.869 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.859+0000 7f5afe309700 1 --2- 172.21.15.55:0/1301027566 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5af813cfc0 0x7f5af80a32a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.859+0000 7f5afe309700 1 --2- 172.21.15.55:0/1301027566 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af806d080 0x7f5af813ca80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.859+0000 7f5afe309700 1 --2- 172.21.15.55:0/1301027566 >> v2:172.21.15.133:3300/0 conn(0x7f5af80682e0 0x7f5af806cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.859+0000 7f5afe309700 1 -- 172.21.15.55:0/1301027566 >> 172.21.15.55:0/1301027566 conn(0x7f5af80b2cf0 msgr2=0x7f5af80b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.859+0000 7f5afe309700 1 -- 172.21.15.55:0/1301027566 shutdown_connections 2023-09-30T02:00:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.859+0000 7f5afe309700 1 -- 172.21.15.55:0/1301027566 wait complete. 2023-09-30T02:00:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.859+0000 7f5afe309700 1 Processor -- start 2023-09-30T02:00:15.870 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afe309700 1 -- start start 2023-09-30T02:00:15.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afe309700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af80682e0 0x7f5af80a87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:15.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afe309700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5af806d080 0x7f5af8137990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:15.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afe309700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5af813cfc0 0x7f5af8137ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:15.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afe309700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8141ff0 con 0x7f5af80682e0 2023-09-30T02:00:15.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afe309700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af80a7890 con 0x7f5af806d080 2023-09-30T02:00:15.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afe309700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af8144330 con 0x7f5af813cfc0 2023-09-30T02:00:15.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afdb08700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5af813cfc0 0x7f5af8137ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:15.871 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afd307700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af80682e0 0x7f5af80a87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afdb08700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5af813cfc0 0x7f5af8137ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:47982/0 (socket says 172.21.15.55:47982) 2023-09-30T02:00:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afdb08700 1 -- 172.21.15.55:0/889108155 learned_addr learned my addr 172.21.15.55:0/889108155 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afcb06700 1 --2- 172.21.15.55:0/889108155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5af806d080 0x7f5af8137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afd307700 1 -- 172.21.15.55:0/889108155 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5af813cfc0 msgr2=0x7f5af8137ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afd307700 1 --2- 172.21.15.55:0/889108155 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5af813cfc0 0x7f5af8137ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afd307700 1 -- 172.21.15.55:0/889108155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5af806d080 msgr2=0x7f5af8137990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afd307700 1 --2- 172.21.15.55:0/889108155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5af806d080 0x7f5af8137990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afd307700 1 -- 172.21.15.55:0/889108155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae80094f0 con 0x7f5af80682e0 2023-09-30T02:00:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afd307700 1 --2- 172.21.15.55:0/889108155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af80682e0 0x7f5af80a87c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5af400ea50 tx=0x7f5af4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:15.872 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5aed7fa700 1 -- 172.21.15.55:0/889108155 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400c640 con 0x7f5af80682e0 2023-09-30T02:00:15.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5aed7fa700 1 -- 172.21.15.55:0/889108155 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5af400c7a0 con 0x7f5af80682e0 2023-09-30T02:00:15.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afe309700 1 -- 172.21.15.55:0/889108155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af80afe60 con 0x7f5af80682e0 2023-09-30T02:00:15.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5aed7fa700 1 -- 172.21.15.55:0/889108155 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5af400cb40 con 0x7f5af80682e0 2023-09-30T02:00:15.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afe309700 1 -- 172.21.15.55:0/889108155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af80a8f20 con 0x7f5af80682e0 2023-09-30T02:00:15.873 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.863+0000 7f5afe309700 1 -- 172.21.15.55:0/889108155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af8064440 con 0x7f5af80682e0 2023-09-30T02:00:15.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.867+0000 7f5aed7fa700 1 -- 172.21.15.55:0/889108155 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f5af4026480 con 0x7f5af80682e0 2023-09-30T02:00:15.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.867+0000 7f5aed7fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:15.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.867+0000 7f5aed7fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:15.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.867+0000 7f5aed7fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:15.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.867+0000 7f5aed7fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:15.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.867+0000 7f5aed7fa700 1 --2- 172.21.15.55:0/889108155 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5adc08e930 0x7f5adc090de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:15.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.867+0000 7f5afcb06700 1 --2- 172.21.15.55:0/889108155 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5adc08e930 0x7f5adc090de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:15.874 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.867+0000 7f5aed7fa700 1 -- 172.21.15.55:0/889108155 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f5af40b5310 con 0x7f5af80682e0 2023-09-30T02:00:15.875 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.871+0000 7f5afcb06700 1 --2- 172.21.15.55:0/889108155 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5adc08e930 0x7f5adc090de0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5af80b39b0 tx=0x7f5ae8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:15.877 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:15.875+0000 7f5aed7fa700 1 -- 172.21.15.55:0/889108155 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f5af4085c10 con 0x7f5af80682e0 2023-09-30T02:00:16.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.067+0000 7f5afe309700 1 -- 172.21.15.55:0/889108155 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f5af81384e0 con 0x7f5af80682e0 2023-09-30T02:00:16.072 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.067+0000 7f5aed7fa700 1 -- 172.21.15.55:0/889108155 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f5af4021080 con 0x7f5af80682e0 2023-09-30T02:00:16.073 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:16.073 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.071+0000 7f5afe309700 10 mgrc shutdown 2023-09-30T02:00:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.071+0000 7f5afe309700 1 -- 172.21.15.55:0/889108155 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5adc08e930 msgr2=0x7f5adc090de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.071+0000 7f5afe309700 1 --2- 172.21.15.55:0/889108155 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5adc08e930 0x7f5adc090de0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5af80b39b0 tx=0x7f5ae8017000 comp rx=0 tx=0).stop 2023-09-30T02:00:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.071+0000 7f5afe309700 1 -- 172.21.15.55:0/889108155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af80682e0 msgr2=0x7f5af80a87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.071+0000 7f5afe309700 1 --2- 172.21.15.55:0/889108155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af80682e0 0x7f5af80a87c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f5af400ea50 tx=0x7f5af4009120 comp rx=0 tx=0).stop 2023-09-30T02:00:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.071+0000 7f5afe309700 1 -- 172.21.15.55:0/889108155 shutdown_connections 2023-09-30T02:00:16.075 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.071+0000 7f5afe309700 1 --2- 172.21.15.55:0/889108155 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f5adc08e930 0x7f5adc090de0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.071+0000 7f5afe309700 1 --2- 172.21.15.55:0/889108155 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f5af813cfc0 0x7f5af8137ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.071+0000 7f5afe309700 1 --2- 172.21.15.55:0/889108155 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f5af806d080 0x7f5af8137990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.071+0000 7f5afe309700 1 --2- 172.21.15.55:0/889108155 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f5af80682e0 0x7f5af80a87c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.071+0000 7f5afe309700 1 -- 172.21.15.55:0/889108155 >> 172.21.15.55:0/889108155 conn(0x7f5af80b2cf0 msgr2=0x7f5af80b30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.071+0000 7f5afe309700 1 -- 172.21.15.55:0/889108155 shutdown_connections 2023-09-30T02:00:16.076 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:16.071+0000 7f5afe309700 1 -- 172.21.15.55:0/889108155 wait complete. 2023-09-30T02:00:19.087 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:19.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.198+0000 7f93f969e700 1 Processor -- start 2023-09-30T02:00:19.204 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.198+0000 7f93f969e700 1 -- start start 2023-09-30T02:00:19.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.198+0000 7f93f969e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40a0d80 0x7f93f40a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:19.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.198+0000 7f93f969e700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93f413e6f0 0x7f93f40a4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:19.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.198+0000 7f93f969e700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93f409f480 con 0x7f93f40a1150 2023-09-30T02:00:19.205 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.198+0000 7f93f969e700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93f409f740 con 0x7f93f413e6f0 2023-09-30T02:00:19.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.198+0000 7f93f969e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f406e040 con 0x7f93f40a0d80 2023-09-30T02:00:19.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.198+0000 7f93f3fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40a0d80 0x7f93f40a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:19.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.198+0000 7f93f8e9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f93f413e6f0 0x7f93f40a4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:19.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.198+0000 7f93f3fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40a0d80 0x7f93f40a4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:47988/0 (socket says 172.21.15.55:47988) 2023-09-30T02:00:19.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.198+0000 7f93f3fff700 1 -- 172.21.15.55:0/3187305716 learned_addr learned my addr 172.21.15.55:0/3187305716 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:19.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f3fff700 1 -- 172.21.15.55:0/3187305716 >> v2:172.21.15.55:3300/0 conn(0x7f93f413e6f0 msgr2=0x7f93f40a4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:19.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f3fff700 1 --2- 172.21.15.55:0/3187305716 >> v2:172.21.15.55:3300/0 conn(0x7f93f413e6f0 0x7f93f40a4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:19.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f3fff700 1 -- 172.21.15.55:0/3187305716 >> v1:172.21.15.133:6789/0 conn(0x7f93f40a1150 legacy=0x7f93f413dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:19.206 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f3fff700 1 -- 172.21.15.55:0/3187305716 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93f40a2240 con 0x7f93f40a0d80 2023-09-30T02:00:19.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f3fff700 1 --2- 172.21.15.55:0/3187305716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40a0d80 0x7f93f40a4a90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f93e80099b0 tx=0x7f93e8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c321743a8649f5c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:19.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f2ffd700 1 -- 172.21.15.55:0/3187305716 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e8009ea0 con 0x7f93f40a0d80 2023-09-30T02:00:19.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f2ffd700 1 -- 172.21.15.55:0/3187305716 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e800b860 con 0x7f93f40a0d80 2023-09-30T02:00:19.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f2ffd700 1 -- 172.21.15.55:0/3187305716 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e800bc00 con 0x7f93f40a0d80 2023-09-30T02:00:19.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f969e700 1 -- 172.21.15.55:0/3187305716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40a0d80 msgr2=0x7f93f40a4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:19.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f969e700 1 --2- 172.21.15.55:0/3187305716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40a0d80 0x7f93f40a4a90 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f93e80099b0 tx=0x7f93e8009250 comp rx=0 tx=0).stop 2023-09-30T02:00:19.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f969e700 1 -- 172.21.15.55:0/3187305716 shutdown_connections 2023-09-30T02:00:19.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f969e700 1 --2- 172.21.15.55:0/3187305716 >> v2:172.21.15.55:3300/0 conn(0x7f93f413e6f0 0x7f93f40a4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:19.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f969e700 1 --2- 172.21.15.55:0/3187305716 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40a0d80 0x7f93f40a4a90 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:19.208 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f969e700 1 -- 172.21.15.55:0/3187305716 >> 172.21.15.55:0/3187305716 conn(0x7f93f40b23d0 msgr2=0x7f93f40b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:19.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f969e700 1 -- 172.21.15.55:0/3187305716 shutdown_connections 2023-09-30T02:00:19.209 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.202+0000 7f93f969e700 1 -- 172.21.15.55:0/3187305716 wait complete. 2023-09-30T02:00:19.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f969e700 1 Processor -- start 2023-09-30T02:00:19.210 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f969e700 1 -- start start 2023-09-30T02:00:19.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f969e700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93f40a0d80 0x7f93f4143d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:19.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f969e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40a1150 0x7f93f4141770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:19.213 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f969e700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f413e6f0 0x7f93f4098110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f969e700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f41512e0 con 0x7f93f413e6f0 2023-09-30T02:00:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f969e700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93f41515a0 con 0x7f93f40a0d80 2023-09-30T02:00:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f969e700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93f4141cb0 con 0x7f93f40a1150 2023-09-30T02:00:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f8e9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f413e6f0 0x7f93f4098110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40a1150 0x7f93f4141770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f8e9d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f413e6f0 0x7f93f4098110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:43132/0 (socket says 172.21.15.55:43132) 2023-09-30T02:00:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f8e9d700 1 -- 172.21.15.55:0/1919370551 learned_addr learned my addr 172.21.15.55:0/1919370551 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40a1150 0x7f93f4141770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:47996/0 (socket says 172.21.15.55:47996) 2023-09-30T02:00:19.214 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f3fff700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93f40a0d80 0x7f93f4143d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f37fe700 1 -- 172.21.15.55:0/1919370551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93f40a0d80 msgr2=0x7f93f4143d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f37fe700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93f40a0d80 0x7f93f4143d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f37fe700 1 -- 172.21.15.55:0/1919370551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f413e6f0 msgr2=0x7f93f4098110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f37fe700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f413e6f0 0x7f93f4098110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f37fe700 1 -- 172.21.15.55:0/1919370551 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e80094f0 con 0x7f93f40a1150 2023-09-30T02:00:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f3fff700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93f40a0d80 0x7f93f4143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T02:00:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f8e9d700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f413e6f0 0x7f93f4098110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T02:00:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93f37fe700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40a1150 0x7f93f4141770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f93e400c910 tx=0x7f93e40016b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.206+0000 7f93dbfff700 1 -- 172.21.15.55:0/1919370551 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4012630 con 0x7f93f40a1150 2023-09-30T02:00:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.210+0000 7f93dbfff700 1 -- 172.21.15.55:0/1919370551 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e40127b0 con 0x7f93f40a1150 2023-09-30T02:00:19.215 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.210+0000 7f93dbfff700 1 -- 172.21.15.55:0/1919370551 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e4012b70 con 0x7f93f40a1150 2023-09-30T02:00:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.210+0000 7f93f969e700 1 -- 172.21.15.55:0/1919370551 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93f4098650 con 0x7f93f40a1150 2023-09-30T02:00:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.210+0000 7f93f969e700 1 -- 172.21.15.55:0/1919370551 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93f4150ea0 con 0x7f93f40a1150 2023-09-30T02:00:19.216 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.210+0000 7f93f969e700 1 -- 172.21.15.55:0/1919370551 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93f4064440 con 0x7f93f40a1150 2023-09-30T02:00:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.214+0000 7f93dbfff700 1 -- 172.21.15.55:0/1919370551 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f93e4003030 con 0x7f93f40a1150 2023-09-30T02:00:19.217 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.214+0000 7f93dbfff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:19.218 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.214+0000 7f93dbfff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:19.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.214+0000 7f93dbfff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:19.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.214+0000 7f93dbfff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:19.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.214+0000 7f93dbfff700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f93e008e8b0 0x7f93e0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:19.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.214+0000 7f93f3fff700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f93e008e8b0 0x7f93e0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:19.219 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.214+0000 7f93dbfff700 1 -- 172.21.15.55:0/1919370551 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f93e40b47b0 con 0x7f93f40a1150 2023-09-30T02:00:19.220 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.214+0000 7f93f3fff700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f93e008e8b0 0x7f93e0090d60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f93e80099b0 tx=0x7f93e8017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:19.224 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.218+0000 7f93dbfff700 1 -- 172.21.15.55:0/1919370551 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f93e40851e0 con 0x7f93f40a1150 2023-09-30T02:00:19.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.414+0000 7f93f969e700 1 -- 172.21.15.55:0/1919370551 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f93f40680b0 con 0x7f93f40a1150 2023-09-30T02:00:19.421 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.414+0000 7f93dbfff700 1 -- 172.21.15.55:0/1919370551 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f93e4088800 con 0x7f93f40a1150 2023-09-30T02:00:19.421 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:19.421 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:19.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.418+0000 7f93f969e700 10 mgrc shutdown 2023-09-30T02:00:19.423 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.418+0000 7f93f969e700 1 -- 172.21.15.55:0/1919370551 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f93e008e8b0 msgr2=0x7f93e0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:19.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.418+0000 7f93f969e700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f93e008e8b0 0x7f93e0090d60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f93e80099b0 tx=0x7f93e8017000 comp rx=0 tx=0).stop 2023-09-30T02:00:19.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.418+0000 7f93f969e700 1 -- 172.21.15.55:0/1919370551 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40a1150 msgr2=0x7f93f4141770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:19.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.418+0000 7f93f969e700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40a1150 0x7f93f4141770 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f93e400c910 tx=0x7f93e40016b0 comp rx=0 tx=0).stop 2023-09-30T02:00:19.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.418+0000 7f93f969e700 1 -- 172.21.15.55:0/1919370551 shutdown_connections 2023-09-30T02:00:19.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.418+0000 7f93f969e700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f93f413e6f0 0x7f93f4098110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:19.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.418+0000 7f93f969e700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f93e008e8b0 0x7f93e0090d60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:19.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.418+0000 7f93f969e700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f93f40a1150 0x7f93f4141770 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:19.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.418+0000 7f93f969e700 1 --2- 172.21.15.55:0/1919370551 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f93f40a0d80 0x7f93f4143d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:19.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.418+0000 7f93f969e700 1 -- 172.21.15.55:0/1919370551 >> 172.21.15.55:0/1919370551 conn(0x7f93f40b23d0 msgr2=0x7f93f406ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:19.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.418+0000 7f93f969e700 1 -- 172.21.15.55:0/1919370551 shutdown_connections 2023-09-30T02:00:19.424 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:19.418+0000 7f93f969e700 1 -- 172.21.15.55:0/1919370551 wait complete. 2023-09-30T02:00:22.435 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:22.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.542+0000 7f3c4a4f5700 1 Processor -- start 2023-09-30T02:00:22.548 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.542+0000 7f3c4a4f5700 1 -- start start 2023-09-30T02:00:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.542+0000 7f3c4a4f5700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c440677c0 0x7f3c440a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.542+0000 7f3c4a4f5700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f3c440a5eb0 0x7f3c4414a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.542+0000 7f3c4a4f5700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c44067b90 con 0x7f3c440a65f0 2023-09-30T02:00:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.542+0000 7f3c4a4f5700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c440a5460 con 0x7f3c440677c0 2023-09-30T02:00:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.542+0000 7f3c4a4f5700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c440a5720 con 0x7f3c440a5eb0 2023-09-30T02:00:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.542+0000 7f3c494f3700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f3c440677c0 0x7f3c440a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c48cf2700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f3c440a65f0 0x7f3c4413f840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58024/0 (socket says 172.21.15.55:58024) 2023-09-30T02:00:22.550 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c48cf2700 1 -- 172.21.15.55:0/500819968 learned_addr learned my addr 172.21.15.55:0/500819968 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T02:00:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c49cf4700 1 --2- 172.21.15.55:0/500819968 >> v2:172.21.15.133:3300/0 conn(0x7f3c440a5eb0 0x7f3c4414a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c494f3700 1 -- 172.21.15.55:0/500819968 >> v2:172.21.15.133:3300/0 conn(0x7f3c440a5eb0 msgr2=0x7f3c4414a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c494f3700 1 --2- 172.21.15.55:0/500819968 >> v2:172.21.15.133:3300/0 conn(0x7f3c440a5eb0 0x7f3c4414a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c494f3700 1 -- 172.21.15.55:0/500819968 >> v1:172.21.15.55:6789/0 conn(0x7f3c440a65f0 legacy=0x7f3c4413f840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c494f3700 1 -- 172.21.15.55:0/500819968 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4413ff50 con 0x7f3c440677c0 2023-09-30T02:00:22.551 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c494f3700 1 --2- 172.21.15.55:0/500819968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c440677c0 0x7f3c440a93d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009e60 tx=0x7f3c3c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=228761fac24628a0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c43fff700 1 -- 172.21.15.55:0/500819968 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c00e070 con 0x7f3c440677c0 2023-09-30T02:00:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c43fff700 1 -- 172.21.15.55:0/500819968 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c00bb20 con 0x7f3c440677c0 2023-09-30T02:00:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c43fff700 1 -- 172.21.15.55:0/500819968 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c012430 con 0x7f3c440677c0 2023-09-30T02:00:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/500819968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c440677c0 msgr2=0x7f3c440a93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c4a4f5700 1 --2- 172.21.15.55:0/500819968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c440677c0 0x7f3c440a93d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c009e60 tx=0x7f3c3c009780 comp rx=0 tx=0).stop 2023-09-30T02:00:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/500819968 shutdown_connections 2023-09-30T02:00:22.552 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c4a4f5700 1 --2- 172.21.15.55:0/500819968 >> v2:172.21.15.133:3300/0 conn(0x7f3c440a5eb0 0x7f3c4414a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c4a4f5700 1 --2- 172.21.15.55:0/500819968 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c440677c0 0x7f3c440a93d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/500819968 >> 172.21.15.55:0/500819968 conn(0x7f3c44068820 msgr2=0x7f3c44068c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/500819968 shutdown_connections 2023-09-30T02:00:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.546+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/500819968 wait complete. 2023-09-30T02:00:22.553 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c4a4f5700 1 Processor -- start 2023-09-30T02:00:22.554 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c4a4f5700 1 -- start start 2023-09-30T02:00:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c4a4f5700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c440677c0 0x7f3c44143910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c4a4f5700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c440a5eb0 0x7f3c44139360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c4a4f5700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c440a65f0 0x7f3c4406cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c4a4f5700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4409a2d0 con 0x7f3c440677c0 2023-09-30T02:00:22.556 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c4a4f5700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c440b5db0 con 0x7f3c440a5eb0 2023-09-30T02:00:22.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c4a4f5700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c44139dc0 con 0x7f3c440a65f0 2023-09-30T02:00:22.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c494f3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c440677c0 0x7f3c44143910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:22.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c494f3700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c440677c0 0x7f3c44143910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36902/0 (socket says 172.21.15.55:36902) 2023-09-30T02:00:22.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c494f3700 1 -- 172.21.15.55:0/3755335365 learned_addr learned my addr 172.21.15.55:0/3755335365 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:22.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c49cf4700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c440a65f0 0x7f3c4406cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:22.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c48cf2700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c440a5eb0 0x7f3c44139360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:22.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c494f3700 1 -- 172.21.15.55:0/3755335365 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c440a65f0 msgr2=0x7f3c4406cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:22.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c494f3700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c440a65f0 0x7f3c4406cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:22.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c494f3700 1 -- 172.21.15.55:0/3755335365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c440a5eb0 msgr2=0x7f3c44139360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:22.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c494f3700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c440a5eb0 0x7f3c44139360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:22.557 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c494f3700 1 -- 172.21.15.55:0/3755335365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3c009a20 con 0x7f3c440677c0 2023-09-30T02:00:22.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c48cf2700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c440a5eb0 0x7f3c44139360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T02:00:22.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c494f3700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c440677c0 0x7f3c44143910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0099f0 tx=0x7f3c3c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:22.558 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c417fa700 1 -- 172.21.15.55:0/3755335365 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c012cf0 con 0x7f3c440677c0 2023-09-30T02:00:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c417fa700 1 -- 172.21.15.55:0/3755335365 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3c027470 con 0x7f3c440677c0 2023-09-30T02:00:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/3755335365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4413a080 con 0x7f3c440677c0 2023-09-30T02:00:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c417fa700 1 -- 172.21.15.55:0/3755335365 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3c027830 con 0x7f3c440677c0 2023-09-30T02:00:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.550+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/3755335365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c44146640 con 0x7f3c440677c0 2023-09-30T02:00:22.559 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.554+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/3755335365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c44064440 con 0x7f3c440677c0 2023-09-30T02:00:22.560 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.554+0000 7f3c417fa700 1 -- 172.21.15.55:0/3755335365 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f3c3c024070 con 0x7f3c440677c0 2023-09-30T02:00:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.554+0000 7f3c417fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.558+0000 7f3c417fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.558+0000 7f3c417fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.558+0000 7f3c417fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:22.561 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.558+0000 7f3c417fa700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f3c3008e8b0 0x7f3c30090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.558+0000 7f3c417fa700 1 -- 172.21.15.55:0/3755335365 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f3c3c0b74c0 con 0x7f3c440677c0 2023-09-30T02:00:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.558+0000 7f3c48cf2700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f3c3008e8b0 0x7f3c30090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:22.562 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.558+0000 7f3c48cf2700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f3c3008e8b0 0x7f3c30090d60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3c4413a4d0 tx=0x7f3c38009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:22.568 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.562+0000 7f3c417fa700 1 -- 172.21.15.55:0/3755335365 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f3c3c087ef0 con 0x7f3c440677c0 2023-09-30T02:00:22.765 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/3755335365 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f3c44099ef0 con 0x7f3c440677c0 2023-09-30T02:00:22.766 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c417fa700 1 -- 172.21.15.55:0/3755335365 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f3c3c08b510 con 0x7f3c440677c0 2023-09-30T02:00:22.766 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:22.766 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:22.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c4a4f5700 10 mgrc shutdown 2023-09-30T02:00:22.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/3755335365 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f3c3008e8b0 msgr2=0x7f3c30090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:22.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c4a4f5700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f3c3008e8b0 0x7f3c30090d60 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3c4413a4d0 tx=0x7f3c38009040 comp rx=0 tx=0).stop 2023-09-30T02:00:22.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/3755335365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c440677c0 msgr2=0x7f3c44143910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:22.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c4a4f5700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c440677c0 0x7f3c44143910 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f3c3c0099f0 tx=0x7f3c3c019000 comp rx=0 tx=0).stop 2023-09-30T02:00:22.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/3755335365 shutdown_connections 2023-09-30T02:00:22.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c4a4f5700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f3c3008e8b0 0x7f3c30090d60 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:22.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c4a4f5700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f3c440a65f0 0x7f3c4406cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:22.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c4a4f5700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f3c440a5eb0 0x7f3c44139360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:22.769 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c4a4f5700 1 --2- 172.21.15.55:0/3755335365 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f3c440677c0 0x7f3c44143910 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:22.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/3755335365 >> 172.21.15.55:0/3755335365 conn(0x7f3c44068820 msgr2=0x7f3c4413c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:22.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/3755335365 shutdown_connections 2023-09-30T02:00:22.770 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:22.762+0000 7f3c4a4f5700 1 -- 172.21.15.55:0/3755335365 wait complete. 2023-09-30T02:00:25.782 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:25.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.890+0000 7fe5b6db4700 1 Processor -- start 2023-09-30T02:00:25.896 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.890+0000 7fe5b6db4700 1 -- start start 2023-09-30T02:00:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.890+0000 7fe5b6db4700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5b00a4990 0x7fe5b00aeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.890+0000 7fe5b6db4700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fe5b013a750 0x7fe5b009f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.890+0000 7fe5b6db4700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5b00af120 con 0x7fe5b00a4d60 2023-09-30T02:00:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.890+0000 7fe5b6db4700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5b009f8b0 con 0x7fe5b013a750 2023-09-30T02:00:25.897 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.890+0000 7fe5b6db4700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b00af5b0 con 0x7fe5b00a4990 2023-09-30T02:00:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.890+0000 7fe5b5db2700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5b00a4990 0x7fe5b00aeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.890+0000 7fe5b55b1700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fe5b00a4d60 0x7fe5b00a1780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:58036/0 (socket says 172.21.15.55:58036) 2023-09-30T02:00:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.890+0000 7fe5b5db2700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5b00a4990 0x7fe5b00aeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:34990/0 (socket says 172.21.15.55:34990) 2023-09-30T02:00:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.890+0000 7fe5b55b1700 1 -- 172.21.15.55:0/3366375061 learned_addr learned my addr 172.21.15.55:0/3366375061 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T02:00:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.890+0000 7fe5b65b3700 1 --2- 172.21.15.55:0/3366375061 >> v2:172.21.15.133:3300/0 conn(0x7fe5b013a750 0x7fe5b009f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b5db2700 1 -- 172.21.15.55:0/3366375061 >> v2:172.21.15.133:3300/0 conn(0x7fe5b013a750 msgr2=0x7fe5b009f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b5db2700 1 --2- 172.21.15.55:0/3366375061 >> v2:172.21.15.133:3300/0 conn(0x7fe5b013a750 0x7fe5b009f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b5db2700 1 -- 172.21.15.55:0/3366375061 >> v1:172.21.15.55:6789/0 conn(0x7fe5b00a4d60 legacy=0x7fe5b00a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:25.898 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b5db2700 1 -- 172.21.15.55:0/3366375061 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5b009fb10 con 0x7fe5b00a4990 2023-09-30T02:00:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b5db2700 1 --2- 172.21.15.55:0/3366375061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5b00a4990 0x7fe5b00aeb90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009e60 tx=0x7fe5a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=605728c1730e35da server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b4db0700 1 -- 172.21.15.55:0/3366375061 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a800e070 con 0x7fe5b00a4990 2023-09-30T02:00:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b4db0700 1 -- 172.21.15.55:0/3366375061 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a800bc30 con 0x7fe5b00a4990 2023-09-30T02:00:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b4db0700 1 -- 172.21.15.55:0/3366375061 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8012430 con 0x7fe5b00a4990 2023-09-30T02:00:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 -- 172.21.15.55:0/3366375061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5b00a4990 msgr2=0x7fe5b00aeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 --2- 172.21.15.55:0/3366375061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5b00a4990 0x7fe5b00aeb90 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8009e60 tx=0x7fe5a8009780 comp rx=0 tx=0).stop 2023-09-30T02:00:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 -- 172.21.15.55:0/3366375061 shutdown_connections 2023-09-30T02:00:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 --2- 172.21.15.55:0/3366375061 >> v2:172.21.15.133:3300/0 conn(0x7fe5b013a750 0x7fe5b009f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:25.900 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 --2- 172.21.15.55:0/3366375061 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5b00a4990 0x7fe5b00aeb90 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:25.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 -- 172.21.15.55:0/3366375061 >> 172.21.15.55:0/3366375061 conn(0x7fe5b00b23d0 msgr2=0x7fe5b00b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:25.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 -- 172.21.15.55:0/3366375061 shutdown_connections 2023-09-30T02:00:25.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 -- 172.21.15.55:0/3366375061 wait complete. 2023-09-30T02:00:25.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 Processor -- start 2023-09-30T02:00:25.901 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 -- start start 2023-09-30T02:00:25.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b00a4990 0x7fe5b0099060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:25.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5b00a4d60 0x7fe5b0148cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:25.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5b013a750 0x7fe5b0149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:25.903 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b0149770 con 0x7fe5b00a4990 2023-09-30T02:00:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b00989c0 con 0x7fe5b013a750 2023-09-30T02:00:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b6db4700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5b0098750 con 0x7fe5b00a4d60 2023-09-30T02:00:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b5db2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b00a4990 0x7fe5b0099060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b55b1700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5b00a4d60 0x7fe5b0148cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b5db2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b00a4990 0x7fe5b0099060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36904/0 (socket says 172.21.15.55:36904) 2023-09-30T02:00:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b5db2700 1 -- 172.21.15.55:0/2758595424 learned_addr learned my addr 172.21.15.55:0/2758595424 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b65b3700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5b013a750 0x7fe5b0149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b5db2700 1 -- 172.21.15.55:0/2758595424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5b00a4d60 msgr2=0x7fe5b0148cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b5db2700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5b00a4d60 0x7fe5b0148cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b5db2700 1 -- 172.21.15.55:0/2758595424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5b013a750 msgr2=0x7fe5b0149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b5db2700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5b013a750 0x7fe5b0149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:25.904 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b5db2700 1 -- 172.21.15.55:0/2758595424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5a8009a20 con 0x7fe5b00a4990 2023-09-30T02:00:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b65b3700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5b013a750 0x7fe5b0149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T02:00:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.894+0000 7fe5b55b1700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5b00a4d60 0x7fe5b0148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T02:00:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.898+0000 7fe5b5db2700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b00a4990 0x7fe5b0099060 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8013000 tx=0x7fe5a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.898+0000 7fe5adffb700 1 -- 172.21.15.55:0/2758595424 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a8012d00 con 0x7fe5b00a4990 2023-09-30T02:00:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.898+0000 7fe5adffb700 1 -- 172.21.15.55:0/2758595424 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5a8012e60 con 0x7fe5b00a4990 2023-09-30T02:00:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.898+0000 7fe5b6db4700 1 -- 172.21.15.55:0/2758595424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5b0149980 con 0x7fe5b00a4990 2023-09-30T02:00:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.898+0000 7fe5adffb700 1 -- 172.21.15.55:0/2758595424 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5a80276c0 con 0x7fe5b00a4990 2023-09-30T02:00:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.898+0000 7fe5b6db4700 1 -- 172.21.15.55:0/2758595424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5b014a430 con 0x7fe5b00a4990 2023-09-30T02:00:25.905 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.898+0000 7fe5b6db4700 1 -- 172.21.15.55:0/2758595424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5b014a650 con 0x7fe5b00a4990 2023-09-30T02:00:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.902+0000 7fe5adffb700 1 -- 172.21.15.55:0/2758595424 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fe5a8024070 con 0x7fe5b00a4990 2023-09-30T02:00:25.906 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.902+0000 7fe5adffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.902+0000 7fe5adffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.902+0000 7fe5adffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.902+0000 7fe5adffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:25.907 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.902+0000 7fe5adffb700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe59c08e830 0x7fe59c090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:25.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.902+0000 7fe5b55b1700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe59c08e830 0x7fe59c090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:25.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.902+0000 7fe5adffb700 1 -- 172.21.15.55:0/2758595424 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fe5a80b6f60 con 0x7fe5b00a4990 2023-09-30T02:00:25.908 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.902+0000 7fe5b55b1700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe59c08e830 0x7fe59c090ce0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe5b013ae10 tx=0x7fe5a4009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:25.913 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:25.906+0000 7fe5adffb700 1 -- 172.21.15.55:0/2758595424 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fe5a80878f0 con 0x7fe5b00a4990 2023-09-30T02:00:26.106 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.102+0000 7fe5b6db4700 1 -- 172.21.15.55:0/2758595424 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fe5b014a650 con 0x7fe5b00a4990 2023-09-30T02:00:26.107 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.102+0000 7fe5adffb700 1 -- 172.21.15.55:0/2758595424 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fe5b014a650 con 0x7fe5b00a4990 2023-09-30T02:00:26.107 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:26.107 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:26.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.102+0000 7fe5b6db4700 10 mgrc shutdown 2023-09-30T02:00:26.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.102+0000 7fe5b6db4700 1 -- 172.21.15.55:0/2758595424 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe59c08e830 msgr2=0x7fe59c090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:26.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.102+0000 7fe5b6db4700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe59c08e830 0x7fe59c090ce0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe5b013ae10 tx=0x7fe5a4009040 comp rx=0 tx=0).stop 2023-09-30T02:00:26.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.102+0000 7fe5b6db4700 1 -- 172.21.15.55:0/2758595424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b00a4990 msgr2=0x7fe5b0099060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:26.109 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.102+0000 7fe5b6db4700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b00a4990 0x7fe5b0099060 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fe5a8013000 tx=0x7fe5a8019000 comp rx=0 tx=0).stop 2023-09-30T02:00:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.106+0000 7fe5b6db4700 1 -- 172.21.15.55:0/2758595424 shutdown_connections 2023-09-30T02:00:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.106+0000 7fe5b6db4700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fe5b013a750 0x7fe5b0149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.106+0000 7fe5b6db4700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fe59c08e830 0x7fe59c090ce0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.106+0000 7fe5b6db4700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fe5b00a4d60 0x7fe5b0148cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.106+0000 7fe5b6db4700 1 --2- 172.21.15.55:0/2758595424 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fe5b00a4990 0x7fe5b0099060 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.106+0000 7fe5b6db4700 1 -- 172.21.15.55:0/2758595424 >> 172.21.15.55:0/2758595424 conn(0x7fe5b00b23d0 msgr2=0x7fe5b01477b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.106+0000 7fe5b6db4700 1 -- 172.21.15.55:0/2758595424 shutdown_connections 2023-09-30T02:00:26.110 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:26.106+0000 7fe5b6db4700 1 -- 172.21.15.55:0/2758595424 wait complete. 2023-09-30T02:00:29.122 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:29.239 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.234+0000 7f9fefc37700 1 Processor -- start 2023-09-30T02:00:29.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.234+0000 7f9fefc37700 1 -- start start 2023-09-30T02:00:29.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.234+0000 7f9fefc37700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f9fe813c140 0x7f9fe813c540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:29.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.234+0000 7f9fefc37700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9fe806da70 0x7f9fe806ded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:29.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.234+0000 7f9fefc37700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fe813ca80 con 0x7f9fe8070150 2023-09-30T02:00:29.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.234+0000 7f9fefc37700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe8070520 con 0x7f9fe806da70 2023-09-30T02:00:29.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.234+0000 7f9fefc37700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9fe80a6c70 con 0x7f9fe813c140 2023-09-30T02:00:29.243 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fee1d4700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9fe806da70 0x7f9fe806ded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fee1d4700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f9fe806da70 0x7f9fe806ded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36910/0 (socket says 172.21.15.55:36910) 2023-09-30T02:00:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fee1d4700 1 -- 172.21.15.55:0/3749604826 learned_addr learned my addr 172.21.15.55:0/3749604826 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fed1d2700 1 --2- 172.21.15.55:0/3749604826 >> v2:172.21.15.133:3300/0 conn(0x7f9fe813c140 0x7f9fe813c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fee1d4700 1 -- 172.21.15.55:0/3749604826 >> v2:172.21.15.133:3300/0 conn(0x7f9fe813c140 msgr2=0x7f9fe813c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fee1d4700 1 --2- 172.21.15.55:0/3749604826 >> v2:172.21.15.133:3300/0 conn(0x7f9fe813c140 0x7f9fe813c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fee1d4700 1 -- 172.21.15.55:0/3749604826 >> v1:172.21.15.133:6789/0 conn(0x7f9fe8070150 legacy=0x7f9fe80a73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fee1d4700 1 -- 172.21.15.55:0/3749604826 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe806e700 con 0x7f9fe806da70 2023-09-30T02:00:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fee1d4700 1 --2- 172.21.15.55:0/3749604826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe806da70 0x7f9fe806ded0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80a6b00 tx=0x7f9fe0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4bd1370df9decc8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fec9d1700 1 -- 172.21.15.55:0/3749604826 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe000e070 con 0x7f9fe806da70 2023-09-30T02:00:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fec9d1700 1 -- 172.21.15.55:0/3749604826 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fe000bab0 con 0x7f9fe806da70 2023-09-30T02:00:29.244 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fec9d1700 1 -- 172.21.15.55:0/3749604826 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fe00092e0 con 0x7f9fe806da70 2023-09-30T02:00:29.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fefc37700 1 -- 172.21.15.55:0/3749604826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe806da70 msgr2=0x7f9fe806ded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:29.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fefc37700 1 --2- 172.21.15.55:0/3749604826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe806da70 0x7f9fe806ded0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9fe80a6b00 tx=0x7f9fe0009840 comp rx=0 tx=0).stop 2023-09-30T02:00:29.245 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fefc37700 1 -- 172.21.15.55:0/3749604826 shutdown_connections 2023-09-30T02:00:29.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fefc37700 1 --2- 172.21.15.55:0/3749604826 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe806da70 0x7f9fe806ded0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:29.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fefc37700 1 --2- 172.21.15.55:0/3749604826 >> v2:172.21.15.133:3300/0 conn(0x7f9fe813c140 0x7f9fe813c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:29.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fefc37700 1 -- 172.21.15.55:0/3749604826 >> 172.21.15.55:0/3749604826 conn(0x7f9fe80b2f00 msgr2=0x7f9fe80b3300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:29.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fefc37700 1 -- 172.21.15.55:0/3749604826 shutdown_connections 2023-09-30T02:00:29.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.238+0000 7f9fefc37700 1 -- 172.21.15.55:0/3749604826 wait complete. 2023-09-30T02:00:29.246 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.242+0000 7f9fefc37700 1 Processor -- start 2023-09-30T02:00:29.247 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.242+0000 7f9fefc37700 1 -- start start 2023-09-30T02:00:29.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.242+0000 7f9fefc37700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fe806da70 0x7f9fe80a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:29.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.242+0000 7f9fefc37700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe8070150 0x7f9fe80ac000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:29.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.242+0000 7f9fefc37700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fe813c140 0x7f9fe80a8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:29.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.242+0000 7f9fefc37700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80a8c10 con 0x7f9fe8070150 2023-09-30T02:00:29.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.242+0000 7f9fefc37700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80a8ed0 con 0x7f9fe806da70 2023-09-30T02:00:29.250 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.242+0000 7f9fefc37700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fe80a4d30 con 0x7f9fe813c140 2023-09-30T02:00:29.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.242+0000 7f9fed1d2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe8070150 0x7f9fe80ac000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:29.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.242+0000 7f9fed1d2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe8070150 0x7f9fe80ac000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:36914/0 (socket says 172.21.15.55:36914) 2023-09-30T02:00:29.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.242+0000 7f9fed1d2700 1 -- 172.21.15.55:0/2453652239 learned_addr learned my addr 172.21.15.55:0/2453652239 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:29.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.242+0000 7f9fee1d4700 1 --2- 172.21.15.55:0/2453652239 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fe813c140 0x7f9fe80a8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:29.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.242+0000 7f9fed9d3700 1 --2- 172.21.15.55:0/2453652239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fe806da70 0x7f9fe80a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:29.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.246+0000 7f9fed1d2700 1 -- 172.21.15.55:0/2453652239 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fe813c140 msgr2=0x7f9fe80a8330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:29.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.246+0000 7f9fed1d2700 1 --2- 172.21.15.55:0/2453652239 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fe813c140 0x7f9fe80a8330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:29.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.246+0000 7f9fed1d2700 1 -- 172.21.15.55:0/2453652239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fe806da70 msgr2=0x7f9fe80a45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:29.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.246+0000 7f9fed1d2700 1 --2- 172.21.15.55:0/2453652239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fe806da70 0x7f9fe80a45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:29.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.246+0000 7f9fed1d2700 1 -- 172.21.15.55:0/2453652239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fe0009ae0 con 0x7f9fe8070150 2023-09-30T02:00:29.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.246+0000 7f9fed1d2700 1 --2- 172.21.15.55:0/2453652239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe8070150 0x7f9fe80ac000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800e950 tx=0x7f9fd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:29.251 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.246+0000 7f9fddffb700 1 -- 172.21.15.55:0/2453652239 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8013680 con 0x7f9fe8070150 2023-09-30T02:00:29.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.246+0000 7f9fddffb700 1 -- 172.21.15.55:0/2453652239 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fd80137e0 con 0x7f9fe8070150 2023-09-30T02:00:29.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.246+0000 7f9fddffb700 1 -- 172.21.15.55:0/2453652239 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fd8013ba0 con 0x7f9fe8070150 2023-09-30T02:00:29.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.246+0000 7f9fefc37700 1 -- 172.21.15.55:0/2453652239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fe80a8870 con 0x7f9fe8070150 2023-09-30T02:00:29.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.246+0000 7f9fefc37700 1 -- 172.21.15.55:0/2453652239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fe80ab100 con 0x7f9fe8070150 2023-09-30T02:00:29.252 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.246+0000 7f9fefc37700 1 -- 172.21.15.55:0/2453652239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fe80b3a10 con 0x7f9fe8070150 2023-09-30T02:00:29.253 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.250+0000 7f9fddffb700 1 -- 172.21.15.55:0/2453652239 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f9fd80253d0 con 0x7f9fe8070150 2023-09-30T02:00:29.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.250+0000 7f9fddffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:29.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.250+0000 7f9fddffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:29.254 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.250+0000 7f9fddffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.250+0000 7f9fddffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.250+0000 7f9fddffb700 1 --2- 172.21.15.55:0/2453652239 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9fcc08e8b0 0x7f9fcc090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.250+0000 7f9fddffb700 1 -- 172.21.15.55:0/2453652239 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f9fd80b5180 con 0x7f9fe8070150 2023-09-30T02:00:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.250+0000 7f9fed9d3700 1 --2- 172.21.15.55:0/2453652239 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9fcc08e8b0 0x7f9fcc090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:29.255 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.250+0000 7f9fed9d3700 1 --2- 172.21.15.55:0/2453652239 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9fcc08e8b0 0x7f9fcc090d60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4003a80 tx=0x7f9fe4007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:29.258 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.254+0000 7f9fddffb700 1 -- 172.21.15.55:0/2453652239 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9fd8085bb0 con 0x7f9fe8070150 2023-09-30T02:00:29.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.442+0000 7f9fefc37700 1 -- 172.21.15.55:0/2453652239 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f9fe80ac9f0 con 0x7f9fe8070150 2023-09-30T02:00:29.449 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.442+0000 7f9fddffb700 1 -- 172.21.15.55:0/2453652239 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f9fd80891d0 con 0x7f9fe8070150 2023-09-30T02:00:29.450 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:29.450 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:29.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.446+0000 7f9fefc37700 10 mgrc shutdown 2023-09-30T02:00:29.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.446+0000 7f9fefc37700 1 -- 172.21.15.55:0/2453652239 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9fcc08e8b0 msgr2=0x7f9fcc090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:29.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.446+0000 7f9fefc37700 1 --2- 172.21.15.55:0/2453652239 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9fcc08e8b0 0x7f9fcc090d60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9fe4003a80 tx=0x7f9fe4007ec0 comp rx=0 tx=0).stop 2023-09-30T02:00:29.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.446+0000 7f9fefc37700 1 -- 172.21.15.55:0/2453652239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe8070150 msgr2=0x7f9fe80ac000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:29.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.446+0000 7f9fefc37700 1 --2- 172.21.15.55:0/2453652239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe8070150 0x7f9fe80ac000 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9fd800e950 tx=0x7f9fd80091a0 comp rx=0 tx=0).stop 2023-09-30T02:00:29.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.446+0000 7f9fefc37700 1 -- 172.21.15.55:0/2453652239 shutdown_connections 2023-09-30T02:00:29.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.446+0000 7f9fefc37700 1 --2- 172.21.15.55:0/2453652239 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9fcc08e8b0 0x7f9fcc090d60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:29.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.446+0000 7f9fefc37700 1 --2- 172.21.15.55:0/2453652239 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fe813c140 0x7f9fe80a8330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:29.452 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.446+0000 7f9fefc37700 1 --2- 172.21.15.55:0/2453652239 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fe8070150 0x7f9fe80ac000 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:29.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.446+0000 7f9fefc37700 1 --2- 172.21.15.55:0/2453652239 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fe806da70 0x7f9fe80a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:29.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.446+0000 7f9fefc37700 1 -- 172.21.15.55:0/2453652239 >> 172.21.15.55:0/2453652239 conn(0x7f9fe80b2f00 msgr2=0x7f9fe8137170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:29.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.446+0000 7f9fefc37700 1 -- 172.21.15.55:0/2453652239 shutdown_connections 2023-09-30T02:00:29.453 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:29.446+0000 7f9fefc37700 1 -- 172.21.15.55:0/2453652239 wait complete. 2023-09-30T02:00:32.465 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:32.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f696a7a8700 1 Processor -- start 2023-09-30T02:00:32.582 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f696a7a8700 1 -- start start 2023-09-30T02:00:32.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f696a7a8700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f696406b5a0 0x7f6964136740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:32.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f696a7a8700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6964136c80 con 0x7f69640a4480 2023-09-30T02:00:32.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f696a7a8700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69640a38e0 con 0x7f69640a9130 2023-09-30T02:00:32.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f696a7a8700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69640a69c0 con 0x7f696406b5a0 2023-09-30T02:00:32.583 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f6968fa5700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f69640a4480 0x7f6964136030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60210/0 (socket says 172.21.15.55:60210) 2023-09-30T02:00:32.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f6968fa5700 1 -- 172.21.15.55:0/639257423 learned_addr learned my addr 172.21.15.55:0/639257423 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T02:00:32.584 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f6969fa7700 1 --2- 172.21.15.55:0/639257423 >> v2:172.21.15.133:3300/0 conn(0x7f696406b5a0 0x7f6964136740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f695bfff700 1 -- 172.21.15.55:0/639257423 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 394268045 0 0) 0x7f6964136c80 con 0x7f69640a4480 2023-09-30T02:00:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f695bfff700 1 -- 172.21.15.55:0/639257423 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6950003570 con 0x7f69640a4480 2023-09-30T02:00:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f6969fa7700 1 -- 172.21.15.55:0/639257423 >> v1:172.21.15.133:6789/0 conn(0x7f69640a9130 legacy=0x7f69640a3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f6969fa7700 1 -- 172.21.15.55:0/639257423 >> v1:172.21.15.55:6789/0 conn(0x7f69640a4480 legacy=0x7f6964136030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f6969fa7700 1 -- 172.21.15.55:0/639257423 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69640a9500 con 0x7f696406b5a0 2023-09-30T02:00:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f6969fa7700 1 --2- 172.21.15.55:0/639257423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f696406b5a0 0x7f6964136740 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f695c009e60 tx=0x7f695c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b159dd2840286a51 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:32.585 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f695bfff700 1 -- 172.21.15.55:0/639257423 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c00e070 con 0x7f696406b5a0 2023-09-30T02:00:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f695bfff700 1 -- 172.21.15.55:0/639257423 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c00bb60 con 0x7f696406b5a0 2023-09-30T02:00:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f695bfff700 1 -- 172.21.15.55:0/639257423 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c012430 con 0x7f696406b5a0 2023-09-30T02:00:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f696a7a8700 1 -- 172.21.15.55:0/639257423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f696406b5a0 msgr2=0x7f6964136740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f696a7a8700 1 --2- 172.21.15.55:0/639257423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f696406b5a0 0x7f6964136740 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f695c009e60 tx=0x7f695c009780 comp rx=0 tx=0).stop 2023-09-30T02:00:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f696a7a8700 1 -- 172.21.15.55:0/639257423 shutdown_connections 2023-09-30T02:00:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f696a7a8700 1 --2- 172.21.15.55:0/639257423 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f696406b5a0 0x7f6964136740 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f696a7a8700 1 -- 172.21.15.55:0/639257423 >> 172.21.15.55:0/639257423 conn(0x7f69640b6940 msgr2=0x7f69640b6d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f696a7a8700 1 -- 172.21.15.55:0/639257423 shutdown_connections 2023-09-30T02:00:32.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.578+0000 7f696a7a8700 1 -- 172.21.15.55:0/639257423 wait complete. 2023-09-30T02:00:32.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f696a7a8700 1 Processor -- start 2023-09-30T02:00:32.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f696a7a8700 1 -- start start 2023-09-30T02:00:32.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f696a7a8700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696406b5a0 0x7f69640a19c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:32.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f696a7a8700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69640a4480 0x7f696414fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:32.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f696a7a8700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69640a9130 0x7f696409fe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:32.588 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f696a7a8700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69640b7a30 con 0x7f69640a9130 2023-09-30T02:00:32.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f696a7a8700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6964150690 con 0x7f69640a4480 2023-09-30T02:00:32.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f696a7a8700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6964150950 con 0x7f696406b5a0 2023-09-30T02:00:32.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f6969fa7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69640a9130 0x7f696409fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:32.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f6969fa7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69640a9130 0x7f696409fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53122/0 (socket says 172.21.15.55:53122) 2023-09-30T02:00:32.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f6969fa7700 1 -- 172.21.15.55:0/3206208411 learned_addr learned my addr 172.21.15.55:0/3206208411 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:32.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f69697a6700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696406b5a0 0x7f69640a19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:32.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f6968fa5700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69640a4480 0x7f696414fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:32.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f6969fa7700 1 -- 172.21.15.55:0/3206208411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696406b5a0 msgr2=0x7f69640a19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:32.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f6969fa7700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696406b5a0 0x7f69640a19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:32.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f6969fa7700 1 -- 172.21.15.55:0/3206208411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69640a4480 msgr2=0x7f696414fc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:32.589 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f6969fa7700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69640a4480 0x7f696414fc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f6969fa7700 1 -- 172.21.15.55:0/3206208411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f695c009a20 con 0x7f69640a9130 2023-09-30T02:00:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f6968fa5700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69640a4480 0x7f696414fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T02:00:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f6969fa7700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69640a9130 0x7f696409fe20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f696406a2d0 tx=0x7f695c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f69597fa700 1 -- 172.21.15.55:0/3206208411 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c027470 con 0x7f69640a9130 2023-09-30T02:00:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f69597fa700 1 -- 172.21.15.55:0/3206208411 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f695c0275f0 con 0x7f69640a9130 2023-09-30T02:00:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f696a7a8700 1 -- 172.21.15.55:0/3206208411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6964143e20 con 0x7f69640a9130 2023-09-30T02:00:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f69597fa700 1 -- 172.21.15.55:0/3206208411 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f695c0279b0 con 0x7f69640a9130 2023-09-30T02:00:32.590 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f696a7a8700 1 -- 172.21.15.55:0/3206208411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6964143820 con 0x7f69640a9130 2023-09-30T02:00:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.582+0000 7f696a7a8700 1 -- 172.21.15.55:0/3206208411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6964064440 con 0x7f69640a9130 2023-09-30T02:00:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.586+0000 7f69597fa700 1 -- 172.21.15.55:0/3206208411 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f695c024070 con 0x7f69640a9130 2023-09-30T02:00:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.586+0000 7f69597fa700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.586+0000 7f69597fa700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:32.591 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.586+0000 7f69597fa700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.586+0000 7f69597fa700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.586+0000 7f69597fa700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f694808e8e0 0x7f6948090d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.586+0000 7f69697a6700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f694808e8e0 0x7f6948090d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.586+0000 7f69597fa700 1 -- 172.21.15.55:0/3206208411 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f695c0b75b0 con 0x7f69640a9130 2023-09-30T02:00:32.592 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.586+0000 7f69697a6700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f694808e8e0 0x7f6948090d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f69600039e0 tx=0x7f6960007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:32.596 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.590+0000 7f69597fa700 1 -- 172.21.15.55:0/3206208411 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f695c087fe0 con 0x7f69640a9130 2023-09-30T02:00:32.791 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.786+0000 7f696a7a8700 1 -- 172.21.15.55:0/3206208411 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f696406e620 con 0x7f69640a9130 2023-09-30T02:00:32.792 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.786+0000 7f69597fa700 1 -- 172.21.15.55:0/3206208411 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f695c08b600 con 0x7f69640a9130 2023-09-30T02:00:32.792 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:32.792 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:32.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.790+0000 7f696a7a8700 10 mgrc shutdown 2023-09-30T02:00:32.794 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.790+0000 7f696a7a8700 1 -- 172.21.15.55:0/3206208411 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f694808e8e0 msgr2=0x7f6948090d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.790+0000 7f696a7a8700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f694808e8e0 0x7f6948090d90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f69600039e0 tx=0x7f6960007ec0 comp rx=0 tx=0).stop 2023-09-30T02:00:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.790+0000 7f696a7a8700 1 -- 172.21.15.55:0/3206208411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69640a9130 msgr2=0x7f696409fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.790+0000 7f696a7a8700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69640a9130 0x7f696409fe20 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f696406a2d0 tx=0x7f695c019000 comp rx=0 tx=0).stop 2023-09-30T02:00:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.790+0000 7f696a7a8700 1 -- 172.21.15.55:0/3206208411 shutdown_connections 2023-09-30T02:00:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.790+0000 7f696a7a8700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f69640a9130 0x7f696409fe20 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.790+0000 7f696a7a8700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f69640a4480 0x7f696414fc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.790+0000 7f696a7a8700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f694808e8e0 0x7f6948090d90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.790+0000 7f696a7a8700 1 --2- 172.21.15.55:0/3206208411 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f696406b5a0 0x7f69640a19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.790+0000 7f696a7a8700 1 -- 172.21.15.55:0/3206208411 >> 172.21.15.55:0/3206208411 conn(0x7f69640b6940 msgr2=0x7f69640677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.790+0000 7f696a7a8700 1 -- 172.21.15.55:0/3206208411 shutdown_connections 2023-09-30T02:00:32.795 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:32.790+0000 7f696a7a8700 1 -- 172.21.15.55:0/3206208411 wait complete. 2023-09-30T02:00:35.812 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:35.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.918+0000 7efcd4854700 1 Processor -- start 2023-09-30T02:00:35.925 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcd4854700 1 -- start start 2023-09-30T02:00:35.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcd4854700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efcd00a4bc0 0x7efcd006b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:35.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcd4854700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7efcd009f930 0x7efcd009fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:35.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcd4854700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efcd00a4f90 con 0x7efcd0135dd0 2023-09-30T02:00:35.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcd4854700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd006bad0 con 0x7efcd00a4bc0 2023-09-30T02:00:35.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcd4854700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efcd00a0810 con 0x7efcd009f930 2023-09-30T02:00:35.927 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efccf7fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7efcd00a4bc0 0x7efcd006b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:35.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcceffd700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7efcd0135dd0 0x7efcd01361d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:60226/0 (socket says 172.21.15.55:60226) 2023-09-30T02:00:35.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcceffd700 1 -- 172.21.15.55:0/3271032899 learned_addr learned my addr 172.21.15.55:0/3271032899 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T02:00:35.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efccffff700 1 --2- 172.21.15.55:0/3271032899 >> v2:172.21.15.133:3300/0 conn(0x7efcd009f930 0x7efcd009fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:35.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcce7fc700 1 -- 172.21.15.55:0/3271032899 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3206103936 0 0) 0x7efcd00a4f90 con 0x7efcd0135dd0 2023-09-30T02:00:35.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcce7fc700 1 -- 172.21.15.55:0/3271032899 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efcb8003570 con 0x7efcd0135dd0 2023-09-30T02:00:35.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efccf7fe700 1 -- 172.21.15.55:0/3271032899 >> v2:172.21.15.133:3300/0 conn(0x7efcd009f930 msgr2=0x7efcd009fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:35.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efccf7fe700 1 --2- 172.21.15.55:0/3271032899 >> v2:172.21.15.133:3300/0 conn(0x7efcd009f930 0x7efcd009fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:35.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efccf7fe700 1 -- 172.21.15.55:0/3271032899 >> v1:172.21.15.55:6789/0 conn(0x7efcd0135dd0 legacy=0x7efcd01361d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:35.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efccf7fe700 1 -- 172.21.15.55:0/3271032899 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd00a0ad0 con 0x7efcd00a4bc0 2023-09-30T02:00:35.928 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efccffff700 1 --2- 172.21.15.55:0/3271032899 >> v2:172.21.15.133:3300/0 conn(0x7efcd009f930 0x7efcd009fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T02:00:35.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efccf7fe700 1 --2- 172.21.15.55:0/3271032899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd00a4bc0 0x7efcd006b590 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efcd006e330 tx=0x7efcc40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c1de0714a7f0eee server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:35.929 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcce7fc700 1 -- 172.21.15.55:0/3271032899 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4011630 con 0x7efcd00a4bc0 2023-09-30T02:00:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcce7fc700 1 -- 172.21.15.55:0/3271032899 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc4011790 con 0x7efcd00a4bc0 2023-09-30T02:00:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcce7fc700 1 -- 172.21.15.55:0/3271032899 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4011b30 con 0x7efcd00a4bc0 2023-09-30T02:00:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcd4854700 1 -- 172.21.15.55:0/3271032899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd00a4bc0 msgr2=0x7efcd006b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcd4854700 1 --2- 172.21.15.55:0/3271032899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd00a4bc0 0x7efcd006b590 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7efcd006e330 tx=0x7efcc40091a0 comp rx=0 tx=0).stop 2023-09-30T02:00:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcd4854700 1 -- 172.21.15.55:0/3271032899 shutdown_connections 2023-09-30T02:00:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcd4854700 1 --2- 172.21.15.55:0/3271032899 >> v2:172.21.15.133:3300/0 conn(0x7efcd009f930 0x7efcd009fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcd4854700 1 --2- 172.21.15.55:0/3271032899 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd00a4bc0 0x7efcd006b590 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcd4854700 1 -- 172.21.15.55:0/3271032899 >> 172.21.15.55:0/3271032899 conn(0x7efcd00b23d0 msgr2=0x7efcd00b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcd4854700 1 -- 172.21.15.55:0/3271032899 shutdown_connections 2023-09-30T02:00:35.930 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.922+0000 7efcd4854700 1 -- 172.21.15.55:0/3271032899 wait complete. 2023-09-30T02:00:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efcd4854700 1 Processor -- start 2023-09-30T02:00:35.931 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efcd4854700 1 -- start start 2023-09-30T02:00:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efcd4854700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd009f930 0x7efcd0138460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efcd4854700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcd00a4bc0 0x7efcd0152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efcd4854700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efcd0135dd0 0x7efcd01426a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efcd4854700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd01376a0 con 0x7efcd009f930 2023-09-30T02:00:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efcd4854700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0153440 con 0x7efcd00a4bc0 2023-09-30T02:00:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efcd4854700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efcd0153700 con 0x7efcd0135dd0 2023-09-30T02:00:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efccf7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd009f930 0x7efcd0138460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efccf7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd009f930 0x7efcd0138460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53140/0 (socket says 172.21.15.55:53140) 2023-09-30T02:00:35.933 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efccf7fe700 1 -- 172.21.15.55:0/2727758065 learned_addr learned my addr 172.21.15.55:0/2727758065 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efccffff700 1 --2- 172.21.15.55:0/2727758065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efcd0135dd0 0x7efcd01426a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efcceffd700 1 --2- 172.21.15.55:0/2727758065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcd00a4bc0 0x7efcd0152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efccf7fe700 1 -- 172.21.15.55:0/2727758065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efcd0135dd0 msgr2=0x7efcd01426a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efccf7fe700 1 --2- 172.21.15.55:0/2727758065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efcd0135dd0 0x7efcd01426a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efccf7fe700 1 -- 172.21.15.55:0/2727758065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcd00a4bc0 msgr2=0x7efcd0152dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efccf7fe700 1 --2- 172.21.15.55:0/2727758065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcd00a4bc0 0x7efcd0152dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efccf7fe700 1 -- 172.21.15.55:0/2727758065 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcc4009420 con 0x7efcd009f930 2023-09-30T02:00:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efccf7fe700 1 --2- 172.21.15.55:0/2727758065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd009f930 0x7efcd0138460 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efcd0062f00 tx=0x7efcc4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efcb77fe700 1 -- 172.21.15.55:0/2727758065 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4011b10 con 0x7efcd009f930 2023-09-30T02:00:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efcb77fe700 1 -- 172.21.15.55:0/2727758065 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcc40233f0 con 0x7efcd009f930 2023-09-30T02:00:35.934 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efcd4854700 1 -- 172.21.15.55:0/2727758065 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd009d6b0 con 0x7efcd009f930 2023-09-30T02:00:35.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efcb77fe700 1 -- 172.21.15.55:0/2727758065 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcc4023790 con 0x7efcd009f930 2023-09-30T02:00:35.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.926+0000 7efcd4854700 1 -- 172.21.15.55:0/2727758065 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd0137e80 con 0x7efcd009f930 2023-09-30T02:00:35.935 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.930+0000 7efcd4854700 1 -- 172.21.15.55:0/2727758065 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd01377e0 con 0x7efcd009f930 2023-09-30T02:00:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.930+0000 7efcb77fe700 1 -- 172.21.15.55:0/2727758065 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7efcc40193b0 con 0x7efcd009f930 2023-09-30T02:00:35.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.930+0000 7efcb77fe700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.930+0000 7efcb77fe700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.930+0000 7efcb77fe700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.930+0000 7efcb77fe700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.930+0000 7efcb77fe700 1 --2- 172.21.15.55:0/2727758065 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7efcbc08e8b0 0x7efcbc090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:35.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.934+0000 7efcb77fe700 1 -- 172.21.15.55:0/2727758065 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7efcc40b5db0 con 0x7efcd009f930 2023-09-30T02:00:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.934+0000 7efcceffd700 1 --2- 172.21.15.55:0/2727758065 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7efcbc08e8b0 0x7efcbc090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:35.938 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.934+0000 7efcceffd700 1 --2- 172.21.15.55:0/2727758065 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7efcbc08e8b0 0x7efcbc090d60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efcd01432f0 tx=0x7efcc0009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:35.943 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:35.938+0000 7efcb77fe700 1 -- 172.21.15.55:0/2727758065 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7efcd01377e0 con 0x7efcd009f930 2023-09-30T02:00:36.139 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.134+0000 7efcd4854700 1 -- 172.21.15.55:0/2727758065 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efcd01377e0 con 0x7efcd009f930 2023-09-30T02:00:36.140 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.134+0000 7efcb77fe700 1 -- 172.21.15.55:0/2727758065 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7efcc4028100 con 0x7efcd009f930 2023-09-30T02:00:36.140 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:36.140 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:36.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.138+0000 7efcd4854700 10 mgrc shutdown 2023-09-30T02:00:36.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.138+0000 7efcd4854700 1 -- 172.21.15.55:0/2727758065 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7efcbc08e8b0 msgr2=0x7efcbc090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:36.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.138+0000 7efcd4854700 1 --2- 172.21.15.55:0/2727758065 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7efcbc08e8b0 0x7efcbc090d60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7efcd01432f0 tx=0x7efcc0009040 comp rx=0 tx=0).stop 2023-09-30T02:00:36.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.138+0000 7efcd4854700 1 -- 172.21.15.55:0/2727758065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd009f930 msgr2=0x7efcd0138460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:36.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.138+0000 7efcd4854700 1 --2- 172.21.15.55:0/2727758065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd009f930 0x7efcd0138460 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7efcd0062f00 tx=0x7efcc4017000 comp rx=0 tx=0).stop 2023-09-30T02:00:36.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.138+0000 7efcd4854700 1 -- 172.21.15.55:0/2727758065 shutdown_connections 2023-09-30T02:00:36.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.138+0000 7efcd4854700 1 --2- 172.21.15.55:0/2727758065 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7efcbc08e8b0 0x7efcbc090d60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:36.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.138+0000 7efcd4854700 1 --2- 172.21.15.55:0/2727758065 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7efcd0135dd0 0x7efcd01426a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:36.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.138+0000 7efcd4854700 1 --2- 172.21.15.55:0/2727758065 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7efcd00a4bc0 0x7efcd0152dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:36.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.138+0000 7efcd4854700 1 --2- 172.21.15.55:0/2727758065 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7efcd009f930 0x7efcd0138460 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:36.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.138+0000 7efcd4854700 1 -- 172.21.15.55:0/2727758065 >> 172.21.15.55:0/2727758065 conn(0x7efcd00b23d0 msgr2=0x7efcd00677f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:36.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.138+0000 7efcd4854700 1 -- 172.21.15.55:0/2727758065 shutdown_connections 2023-09-30T02:00:36.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:36.138+0000 7efcd4854700 1 -- 172.21.15.55:0/2727758065 wait complete. 2023-09-30T02:00:39.155 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:39.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.262+0000 7f7791cf9700 1 Processor -- start 2023-09-30T02:00:39.269 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.262+0000 7f7791cf9700 1 -- start start 2023-09-30T02:00:39.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7791cf9700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f778c140b10 0x7f778c0a5190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:39.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7791cf9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f778c0affa0 0x7f778c06d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:39.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7791cf9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f778c0a58d0 con 0x7f778c13ca80 2023-09-30T02:00:39.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7791cf9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f778c0a56d0 con 0x7f778c0affa0 2023-09-30T02:00:39.270 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7791cf9700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c140180 con 0x7f778c140b10 2023-09-30T02:00:39.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7790cf7700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f778c140b10 0x7f778c0a5190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:39.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f778bfff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f778c0affa0 0x7f778c06d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:39.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7790cf7700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f778c140b10 0x7f778c0a5190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:35256/0 (socket says 172.21.15.55:35256) 2023-09-30T02:00:39.271 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7790cf7700 1 -- 172.21.15.55:0/4049787027 learned_addr learned my addr 172.21.15.55:0/4049787027 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:39.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7790cf7700 1 -- 172.21.15.55:0/4049787027 >> v2:172.21.15.55:3300/0 conn(0x7f778c0affa0 msgr2=0x7f778c06d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:39.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7790cf7700 1 --2- 172.21.15.55:0/4049787027 >> v2:172.21.15.55:3300/0 conn(0x7f778c0affa0 0x7f778c06d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:39.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7790cf7700 1 -- 172.21.15.55:0/4049787027 >> v1:172.21.15.133:6789/0 conn(0x7f778c13ca80 legacy=0x7f778c13cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:39.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7790cf7700 1 -- 172.21.15.55:0/4049787027 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778c06dab0 con 0x7f778c140b10 2023-09-30T02:00:39.272 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7790cf7700 1 --2- 172.21.15.55:0/4049787027 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f778c140b10 0x7f778c0a5190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f778400d1a0 tx=0x7f778400ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f070d9573fdbec8 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:39.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f778b7fe700 1 -- 172.21.15.55:0/4049787027 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7784010070 con 0x7f778c140b10 2023-09-30T02:00:39.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f778b7fe700 1 -- 172.21.15.55:0/4049787027 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778400de10 con 0x7f778c140b10 2023-09-30T02:00:39.273 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f778b7fe700 1 -- 172.21.15.55:0/4049787027 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f778400b320 con 0x7f778c140b10 2023-09-30T02:00:39.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7791cf9700 1 -- 172.21.15.55:0/4049787027 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f778c140b10 msgr2=0x7f778c0a5190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:39.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7791cf9700 1 --2- 172.21.15.55:0/4049787027 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f778c140b10 0x7f778c0a5190 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f778400d1a0 tx=0x7f778400ba50 comp rx=0 tx=0).stop 2023-09-30T02:00:39.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7791cf9700 1 -- 172.21.15.55:0/4049787027 shutdown_connections 2023-09-30T02:00:39.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7791cf9700 1 --2- 172.21.15.55:0/4049787027 >> v2:172.21.15.55:3300/0 conn(0x7f778c0affa0 0x7f778c06d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:39.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7791cf9700 1 --2- 172.21.15.55:0/4049787027 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f778c140b10 0x7f778c0a5190 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:39.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7791cf9700 1 -- 172.21.15.55:0/4049787027 >> 172.21.15.55:0/4049787027 conn(0x7f778c0681b0 msgr2=0x7f778c0685b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:39.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7791cf9700 1 -- 172.21.15.55:0/4049787027 shutdown_connections 2023-09-30T02:00:39.274 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.266+0000 7f7791cf9700 1 -- 172.21.15.55:0/4049787027 wait complete. 2023-09-30T02:00:39.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.270+0000 7f7791cf9700 1 Processor -- start 2023-09-30T02:00:39.275 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.270+0000 7f7791cf9700 1 -- start start 2023-09-30T02:00:39.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.270+0000 7f7791cf9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f778c0affa0 0x7f778c0a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:39.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.270+0000 7f7791cf9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f778c13ca80 0x7f778c135fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:39.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.270+0000 7f7791cf9700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f778c140b10 0x7f778c13ee10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:39.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.270+0000 7f7791cf9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c0a9b30 con 0x7f778c13ca80 2023-09-30T02:00:39.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.270+0000 7f7791cf9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f778c136500 con 0x7f778c0affa0 2023-09-30T02:00:39.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.270+0000 7f7791cf9700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f778c135ac0 con 0x7f778c140b10 2023-09-30T02:00:39.277 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.270+0000 7f778bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f778c13ca80 0x7f778c135fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:39.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.270+0000 7f778bfff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f778c13ca80 0x7f778c135fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:53160/0 (socket says 172.21.15.55:53160) 2023-09-30T02:00:39.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.270+0000 7f7790cf7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f778c0affa0 0x7f778c0a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:39.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.270+0000 7f778bfff700 1 -- 172.21.15.55:0/2342442439 learned_addr learned my addr 172.21.15.55:0/2342442439 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:39.278 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.270+0000 7f77914f8700 1 --2- 172.21.15.55:0/2342442439 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f778c140b10 0x7f778c13ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:39.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.274+0000 7f778bfff700 1 -- 172.21.15.55:0/2342442439 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f778c140b10 msgr2=0x7f778c13ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:39.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.274+0000 7f778bfff700 1 --2- 172.21.15.55:0/2342442439 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f778c140b10 0x7f778c13ee10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:39.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.274+0000 7f778bfff700 1 -- 172.21.15.55:0/2342442439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f778c0affa0 msgr2=0x7f778c0a95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:39.279 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.274+0000 7f778bfff700 1 --2- 172.21.15.55:0/2342442439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f778c0affa0 0x7f778c0a95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.274+0000 7f778bfff700 1 -- 172.21.15.55:0/2342442439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f778400bcf0 con 0x7f778c13ca80 2023-09-30T02:00:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.274+0000 7f778bfff700 1 --2- 172.21.15.55:0/2342442439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f778c13ca80 0x7f778c135fc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f778000e930 tx=0x7f77800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.274+0000 7f7788ff9700 1 -- 172.21.15.55:0/2342442439 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780013680 con 0x7f778c13ca80 2023-09-30T02:00:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.274+0000 7f7788ff9700 1 -- 172.21.15.55:0/2342442439 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77800137e0 con 0x7f778c13ca80 2023-09-30T02:00:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.274+0000 7f7791cf9700 1 -- 172.21.15.55:0/2342442439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f778c134bd0 con 0x7f778c13ca80 2023-09-30T02:00:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.274+0000 7f7788ff9700 1 -- 172.21.15.55:0/2342442439 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780013b80 con 0x7f778c13ca80 2023-09-30T02:00:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.274+0000 7f7791cf9700 1 -- 172.21.15.55:0/2342442439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f778c13fa30 con 0x7f778c13ca80 2023-09-30T02:00:39.280 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.274+0000 7f7791cf9700 1 -- 172.21.15.55:0/2342442439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f778c064440 con 0x7f778c13ca80 2023-09-30T02:00:39.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.278+0000 7f7788ff9700 1 -- 172.21.15.55:0/2342442439 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f778000c3e0 con 0x7f778c13ca80 2023-09-30T02:00:39.281 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.278+0000 7f7788ff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:39.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.278+0000 7f7788ff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:39.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.278+0000 7f7788ff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:39.282 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.278+0000 7f7788ff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:39.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.278+0000 7f7788ff9700 1 --2- 172.21.15.55:0/2342442439 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f777808e8b0 0x7f7778090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:39.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.278+0000 7f7788ff9700 1 -- 172.21.15.55:0/2342442439 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f77800b5150 con 0x7f778c13ca80 2023-09-30T02:00:39.283 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.278+0000 7f7790cf7700 1 --2- 172.21.15.55:0/2342442439 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f777808e8b0 0x7f7778090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:39.284 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.278+0000 7f7790cf7700 1 --2- 172.21.15.55:0/2342442439 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f777808e8b0 0x7f7778090d60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f778400ba90 tx=0x7f778401a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:39.287 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.282+0000 7f7788ff9700 1 -- 172.21.15.55:0/2342442439 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7780085af0 con 0x7f778c13ca80 2023-09-30T02:00:39.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7791cf9700 1 -- 172.21.15.55:0/2342442439 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f778c0a46f0 con 0x7f778c13ca80 2023-09-30T02:00:39.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7788ff9700 1 -- 172.21.15.55:0/2342442439 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f7780017100 con 0x7f778c13ca80 2023-09-30T02:00:39.479 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:39.479 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:39.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7791cf9700 10 mgrc shutdown 2023-09-30T02:00:39.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7791cf9700 1 -- 172.21.15.55:0/2342442439 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f777808e8b0 msgr2=0x7f7778090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:39.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7791cf9700 1 --2- 172.21.15.55:0/2342442439 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f777808e8b0 0x7f7778090d60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f778400ba90 tx=0x7f778401a000 comp rx=0 tx=0).stop 2023-09-30T02:00:39.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7791cf9700 1 -- 172.21.15.55:0/2342442439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f778c13ca80 msgr2=0x7f778c135fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:39.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7791cf9700 1 --2- 172.21.15.55:0/2342442439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f778c13ca80 0x7f778c135fc0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f778000e930 tx=0x7f77800091a0 comp rx=0 tx=0).stop 2023-09-30T02:00:39.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7791cf9700 1 -- 172.21.15.55:0/2342442439 shutdown_connections 2023-09-30T02:00:39.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7791cf9700 1 --2- 172.21.15.55:0/2342442439 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f777808e8b0 0x7f7778090d60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:39.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7791cf9700 1 --2- 172.21.15.55:0/2342442439 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f778c140b10 0x7f778c13ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:39.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7791cf9700 1 --2- 172.21.15.55:0/2342442439 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f778c13ca80 0x7f778c135fc0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:39.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7791cf9700 1 --2- 172.21.15.55:0/2342442439 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f778c0affa0 0x7f778c0a95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:39.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7791cf9700 1 -- 172.21.15.55:0/2342442439 >> 172.21.15.55:0/2342442439 conn(0x7f778c0681b0 msgr2=0x7f778c0b1550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:39.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7791cf9700 1 -- 172.21.15.55:0/2342442439 shutdown_connections 2023-09-30T02:00:39.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:39.474+0000 7f7791cf9700 1 -- 172.21.15.55:0/2342442439 wait complete. 2023-09-30T02:00:42.493 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:42.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.606+0000 7fbe64881700 1 Processor -- start 2023-09-30T02:00:42.612 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.606+0000 7fbe64881700 1 -- start start 2023-09-30T02:00:42.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.606+0000 7fbe64881700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe600abf10 0x7fbe601434f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:42.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.606+0000 7fbe64881700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe6006be70 0x7fbe60135cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:42.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.606+0000 7fbe64881700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe600b3e10 con 0x7fbe600b3a40 2023-09-30T02:00:42.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.606+0000 7fbe64881700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe6006d660 con 0x7fbe6006be70 2023-09-30T02:00:42.613 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.606+0000 7fbe64881700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe6006dbe0 con 0x7fbe600abf10 2023-09-30T02:00:42.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe5ed9d700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fbe6006be70 0x7fbe60135cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:42.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.606+0000 7fbe5e59c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fbe600b3a40 0x7fbe60143e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:36166/0 (socket says 172.21.15.55:36166) 2023-09-30T02:00:42.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe57fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe600abf10 0x7fbe601434f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:42.614 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe5e59c700 1 -- 172.21.15.55:0/948897557 learned_addr learned my addr 172.21.15.55:0/948897557 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T02:00:42.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe5dd9b700 1 -- 172.21.15.55:0/948897557 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3809243873 0 0) 0x7fbe600b3e10 con 0x7fbe600b3a40 2023-09-30T02:00:42.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe5dd9b700 1 -- 172.21.15.55:0/948897557 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbe4c003570 con 0x7fbe600b3a40 2023-09-30T02:00:42.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe5ed9d700 1 -- 172.21.15.55:0/948897557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe600abf10 msgr2=0x7fbe601434f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:42.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe5ed9d700 1 --2- 172.21.15.55:0/948897557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe600abf10 0x7fbe601434f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:42.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe5ed9d700 1 -- 172.21.15.55:0/948897557 >> v1:172.21.15.55:6789/0 conn(0x7fbe600b3a40 legacy=0x7fbe60143e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:42.615 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe5ed9d700 1 -- 172.21.15.55:0/948897557 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe6006c3b0 con 0x7fbe6006be70 2023-09-30T02:00:42.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe57fff700 1 --2- 172.21.15.55:0/948897557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe600abf10 0x7fbe601434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T02:00:42.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe5ed9d700 1 --2- 172.21.15.55:0/948897557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe6006be70 0x7fbe60135cf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009e90 tx=0x7fbe58009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba431041a8b74554 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:42.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe5dd9b700 1 -- 172.21.15.55:0/948897557 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe5800e070 con 0x7fbe6006be70 2023-09-30T02:00:42.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe5dd9b700 1 -- 172.21.15.55:0/948897557 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe5800bb40 con 0x7fbe6006be70 2023-09-30T02:00:42.616 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe5dd9b700 1 -- 172.21.15.55:0/948897557 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58012430 con 0x7fbe6006be70 2023-09-30T02:00:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe64881700 1 -- 172.21.15.55:0/948897557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe6006be70 msgr2=0x7fbe60135cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe64881700 1 --2- 172.21.15.55:0/948897557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe6006be70 0x7fbe60135cf0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbe58009e90 tx=0x7fbe58009780 comp rx=0 tx=0).stop 2023-09-30T02:00:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe64881700 1 -- 172.21.15.55:0/948897557 shutdown_connections 2023-09-30T02:00:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe64881700 1 --2- 172.21.15.55:0/948897557 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe6006be70 0x7fbe60135cf0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe64881700 1 --2- 172.21.15.55:0/948897557 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe600abf10 0x7fbe601434f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe64881700 1 -- 172.21.15.55:0/948897557 >> 172.21.15.55:0/948897557 conn(0x7fbe60062c70 msgr2=0x7fbe60063070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe64881700 1 -- 172.21.15.55:0/948897557 shutdown_connections 2023-09-30T02:00:42.617 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.610+0000 7fbe64881700 1 -- 172.21.15.55:0/948897557 wait complete. 2023-09-30T02:00:42.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe64881700 1 Processor -- start 2023-09-30T02:00:42.618 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe64881700 1 -- start start 2023-09-30T02:00:42.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe64881700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe6006be70 0x7fbe600b0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:42.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe64881700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe600abf10 0x7fbe60130d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:42.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe64881700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe600b3a40 0x7fbe60152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:42.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe64881700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe600b24a0 con 0x7fbe6006be70 2023-09-30T02:00:42.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe64881700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe60131620 con 0x7fbe600abf10 2023-09-30T02:00:42.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe64881700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe601318c0 con 0x7fbe600b3a40 2023-09-30T02:00:42.621 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe5e59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe6006be70 0x7fbe600b0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe5ed9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe600b3a40 0x7fbe60152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe5ed9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe600b3a40 0x7fbe60152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:33340/0 (socket says 172.21.15.55:33340) 2023-09-30T02:00:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe5ed9d700 1 -- 172.21.15.55:0/3240635070 learned_addr learned my addr 172.21.15.55:0/3240635070 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe57fff700 1 --2- 172.21.15.55:0/3240635070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe600abf10 0x7fbe60130d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe5ed9d700 1 -- 172.21.15.55:0/3240635070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe600abf10 msgr2=0x7fbe60130d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe5ed9d700 1 --2- 172.21.15.55:0/3240635070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe600abf10 0x7fbe60130d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe5ed9d700 1 -- 172.21.15.55:0/3240635070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe6006be70 msgr2=0x7fbe600b0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe5ed9d700 1 --2- 172.21.15.55:0/3240635070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe6006be70 0x7fbe600b0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe5ed9d700 1 -- 172.21.15.55:0/3240635070 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe48009420 con 0x7fbe600b3a40 2023-09-30T02:00:42.622 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe57fff700 1 --2- 172.21.15.55:0/3240635070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe600abf10 0x7fbe60130d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T02:00:42.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe5ed9d700 1 --2- 172.21.15.55:0/3240635070 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe600b3a40 0x7fbe60152cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800b610 tx=0x7fbe58019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:42.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe567fc700 1 -- 172.21.15.55:0/3240635070 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe58027470 con 0x7fbe600b3a40 2023-09-30T02:00:42.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe567fc700 1 -- 172.21.15.55:0/3240635070 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe580275f0 con 0x7fbe600b3a40 2023-09-30T02:00:42.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe64881700 1 -- 172.21.15.55:0/3240635070 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe58009a20 con 0x7fbe600b3a40 2023-09-30T02:00:42.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe567fc700 1 -- 172.21.15.55:0/3240635070 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe580279b0 con 0x7fbe600b3a40 2023-09-30T02:00:42.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.614+0000 7fbe64881700 1 -- 172.21.15.55:0/3240635070 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe600b0620 con 0x7fbe600b3a40 2023-09-30T02:00:42.623 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.618+0000 7fbe64881700 1 -- 172.21.15.55:0/3240635070 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe6006a720 con 0x7fbe600b3a40 2023-09-30T02:00:42.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.618+0000 7fbe567fc700 1 -- 172.21.15.55:0/3240635070 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fbe58024070 con 0x7fbe600b3a40 2023-09-30T02:00:42.624 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.618+0000 7fbe567fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:42.625 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.618+0000 7fbe567fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:42.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.618+0000 7fbe567fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:42.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.618+0000 7fbe567fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:42.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.618+0000 7fbe567fc700 1 --2- 172.21.15.55:0/3240635070 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbe4008e8b0 0x7fbe40090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:42.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.622+0000 7fbe567fc700 1 -- 172.21.15.55:0/3240635070 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fbe580b76b0 con 0x7fbe600b3a40 2023-09-30T02:00:42.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.622+0000 7fbe5e59c700 1 --2- 172.21.15.55:0/3240635070 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbe4008e8b0 0x7fbe40090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:42.626 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.622+0000 7fbe5e59c700 1 --2- 172.21.15.55:0/3240635070 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbe4008e8b0 0x7fbe40090d60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbe50007fd0 tx=0x7fbe50009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:42.632 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.626+0000 7fbe567fc700 1 -- 172.21.15.55:0/3240635070 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbe5805dbe0 con 0x7fbe600b3a40 2023-09-30T02:00:42.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.826+0000 7fbe64881700 1 -- 172.21.15.55:0/3240635070 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbe600a5810 con 0x7fbe600b3a40 2023-09-30T02:00:42.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.826+0000 7fbe567fc700 1 -- 172.21.15.55:0/3240635070 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fbe580880e0 con 0x7fbe600b3a40 2023-09-30T02:00:42.831 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:42.831 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:42.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.826+0000 7fbe64881700 10 mgrc shutdown 2023-09-30T02:00:42.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.830+0000 7fbe64881700 1 -- 172.21.15.55:0/3240635070 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbe4008e8b0 msgr2=0x7fbe40090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:42.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.830+0000 7fbe64881700 1 --2- 172.21.15.55:0/3240635070 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbe4008e8b0 0x7fbe40090d60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbe50007fd0 tx=0x7fbe50009040 comp rx=0 tx=0).stop 2023-09-30T02:00:42.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.830+0000 7fbe64881700 1 -- 172.21.15.55:0/3240635070 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe600b3a40 msgr2=0x7fbe60152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:42.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.830+0000 7fbe64881700 1 --2- 172.21.15.55:0/3240635070 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe600b3a40 0x7fbe60152cf0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbe5800b610 tx=0x7fbe58019000 comp rx=0 tx=0).stop 2023-09-30T02:00:42.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.830+0000 7fbe64881700 1 -- 172.21.15.55:0/3240635070 shutdown_connections 2023-09-30T02:00:42.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.830+0000 7fbe64881700 1 --2- 172.21.15.55:0/3240635070 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbe4008e8b0 0x7fbe40090d60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:42.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.830+0000 7fbe64881700 1 --2- 172.21.15.55:0/3240635070 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbe600b3a40 0x7fbe60152cf0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:42.834 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.830+0000 7fbe64881700 1 --2- 172.21.15.55:0/3240635070 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbe600abf10 0x7fbe60130d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:42.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.830+0000 7fbe64881700 1 --2- 172.21.15.55:0/3240635070 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbe6006be70 0x7fbe600b0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:42.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.830+0000 7fbe64881700 1 -- 172.21.15.55:0/3240635070 >> 172.21.15.55:0/3240635070 conn(0x7fbe60062c70 msgr2=0x7fbe60063040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:42.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.830+0000 7fbe64881700 1 -- 172.21.15.55:0/3240635070 shutdown_connections 2023-09-30T02:00:42.835 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:42.830+0000 7fbe64881700 1 -- 172.21.15.55:0/3240635070 wait complete. 2023-09-30T02:00:44.314 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T02:00:44.317 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T02:00:45.846 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:45.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.954+0000 7f40a2ea2700 1 Processor -- start 2023-09-30T02:00:45.961 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.954+0000 7f40a2ea2700 1 -- start start 2023-09-30T02:00:45.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a2ea2700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f409c13d490 0x7f409c06c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:45.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a2ea2700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f409c06ff20 0x7f409c13fec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:45.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a2ea2700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f409c06c810 con 0x7f409c0702f0 2023-09-30T02:00:45.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a2ea2700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f409c1409e0 con 0x7f409c13d490 2023-09-30T02:00:45.963 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a2ea2700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409c140ca0 con 0x7f409c06ff20 2023-09-30T02:00:45.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a169f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f409c06ff20 0x7f409c13fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:45.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a169f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f409c06ff20 0x7f409c13fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:33356/0 (socket says 172.21.15.55:33356) 2023-09-30T02:00:45.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a169f700 1 -- 172.21.15.55:0/1374992994 learned_addr learned my addr 172.21.15.55:0/1374992994 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:45.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a1ea0700 1 --2- 172.21.15.55:0/1374992994 >> v2:172.21.15.133:3300/0 conn(0x7f409c13d490 0x7f409c06c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:45.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a169f700 1 -- 172.21.15.55:0/1374992994 >> v2:172.21.15.133:3300/0 conn(0x7f409c13d490 msgr2=0x7f409c06c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:45.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a169f700 1 --2- 172.21.15.55:0/1374992994 >> v2:172.21.15.133:3300/0 conn(0x7f409c13d490 0x7f409c06c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:45.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a169f700 1 -- 172.21.15.55:0/1374992994 >> v1:172.21.15.133:6789/0 conn(0x7f409c0702f0 legacy=0x7f409c143510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:45.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a169f700 1 -- 172.21.15.55:0/1374992994 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c06ccb0 con 0x7f409c06ff20 2023-09-30T02:00:45.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a1ea0700 1 --2- 172.21.15.55:0/1374992994 >> v2:172.21.15.133:3300/0 conn(0x7f409c13d490 0x7f409c06c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-09-30T02:00:45.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a169f700 1 --2- 172.21.15.55:0/1374992994 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f409c06ff20 0x7f409c13fec0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f408c0099b0 tx=0x7f408c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=97050d98bd6d9fae server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:45.964 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a0e9e700 1 -- 172.21.15.55:0/1374992994 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c00b860 con 0x7f409c06ff20 2023-09-30T02:00:45.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a0e9e700 1 -- 172.21.15.55:0/1374992994 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408c00b9c0 con 0x7f409c06ff20 2023-09-30T02:00:45.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a0e9e700 1 -- 172.21.15.55:0/1374992994 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c00bd60 con 0x7f409c06ff20 2023-09-30T02:00:45.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1374992994 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f409c06ff20 msgr2=0x7f409c13fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:45.965 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a2ea2700 1 --2- 172.21.15.55:0/1374992994 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f409c06ff20 0x7f409c13fec0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f408c0099b0 tx=0x7f408c009250 comp rx=0 tx=0).stop 2023-09-30T02:00:45.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1374992994 shutdown_connections 2023-09-30T02:00:45.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a2ea2700 1 --2- 172.21.15.55:0/1374992994 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f409c06ff20 0x7f409c13fec0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:45.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a2ea2700 1 --2- 172.21.15.55:0/1374992994 >> v2:172.21.15.133:3300/0 conn(0x7f409c13d490 0x7f409c06c2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:45.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1374992994 >> 172.21.15.55:0/1374992994 conn(0x7f409c0b2cf0 msgr2=0x7f409c0b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:45.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1374992994 shutdown_connections 2023-09-30T02:00:45.966 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.958+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1374992994 wait complete. 2023-09-30T02:00:45.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a2ea2700 1 Processor -- start 2023-09-30T02:00:45.967 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a2ea2700 1 -- start start 2023-09-30T02:00:45.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a2ea2700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f409c06ff20 0x7f409c13bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:45.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a2ea2700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f409c0702f0 0x7f409c153920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:45.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a2ea2700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f409c13d490 0x7f409c0adb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:45.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a2ea2700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c13c1c0 con 0x7f409c13d490 2023-09-30T02:00:45.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a2ea2700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409c0af8e0 con 0x7f409c0702f0 2023-09-30T02:00:45.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a2ea2700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409c1545a0 con 0x7f409c06ff20 2023-09-30T02:00:45.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a1ea0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f409c06ff20 0x7f409c13bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:45.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a1ea0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f409c06ff20 0x7f409c13bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:33368/0 (socket says 172.21.15.55:33368) 2023-09-30T02:00:45.969 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a1ea0700 1 -- 172.21.15.55:0/1896139610 learned_addr learned my addr 172.21.15.55:0/1896139610 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:45.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a26a1700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f409c13d490 0x7f409c0adb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:45.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a169f700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f409c0702f0 0x7f409c153920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:45.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a26a1700 1 -- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f409c06ff20 msgr2=0x7f409c13bc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:45.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a26a1700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f409c06ff20 0x7f409c13bc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:45.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a26a1700 1 -- 172.21.15.55:0/1896139610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f409c0702f0 msgr2=0x7f409c153920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:45.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a26a1700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f409c0702f0 0x7f409c153920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:45.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a26a1700 1 -- 172.21.15.55:0/1896139610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c0094f0 con 0x7f409c13d490 2023-09-30T02:00:45.970 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a1ea0700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f409c06ff20 0x7f409c13bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T02:00:45.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.962+0000 7f40a26a1700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f409c13d490 0x7f409c0adb00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f409800c510 tx=0x7f4098007e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:45.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.966+0000 7f4091ffb700 1 -- 172.21.15.55:0/1896139610 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f409800ce40 con 0x7f409c13d490 2023-09-30T02:00:45.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.966+0000 7f4091ffb700 1 -- 172.21.15.55:0/1896139610 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4098011590 con 0x7f409c13d490 2023-09-30T02:00:45.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.966+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1896139610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f409c0aec70 con 0x7f409c13d490 2023-09-30T02:00:45.971 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.966+0000 7f4091ffb700 1 -- 172.21.15.55:0/1896139610 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4098011950 con 0x7f409c13d490 2023-09-30T02:00:45.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.966+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1896139610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f409c151200 con 0x7f409c13d490 2023-09-30T02:00:45.972 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.966+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1896139610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409c0af060 con 0x7f409c13d490 2023-09-30T02:00:45.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.970+0000 7f4091ffb700 1 -- 172.21.15.55:0/1896139610 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f4098011d00 con 0x7f409c13d490 2023-09-30T02:00:45.973 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.970+0000 7f4091ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:45.974 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.970+0000 7f4091ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:45.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.970+0000 7f4091ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:45.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.970+0000 7f4091ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:45.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.970+0000 7f4091ffb700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f408008e8b0 0x7f4080090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:45.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.970+0000 7f40a1ea0700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f408008e8b0 0x7f4080090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:45.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.970+0000 7f4091ffb700 1 -- 172.21.15.55:0/1896139610 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f40980b3b10 con 0x7f409c13d490 2023-09-30T02:00:45.975 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.970+0000 7f40a1ea0700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f408008e8b0 0x7f4080090d60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f409400dae0 tx=0x7f40940078c0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:45.980 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:45.974+0000 7f4091ffb700 1 -- 172.21.15.55:0/1896139610 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f4098084540 con 0x7f409c13d490 2023-09-30T02:00:46.179 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.174+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1896139610 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f409c064440 con 0x7f409c13d490 2023-09-30T02:00:46.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.174+0000 7f4091ffb700 1 -- 172.21.15.55:0/1896139610 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f4098017020 con 0x7f409c13d490 2023-09-30T02:00:46.180 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:46.180 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:46.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.178+0000 7f40a2ea2700 10 mgrc shutdown 2023-09-30T02:00:46.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.178+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f408008e8b0 msgr2=0x7f4080090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:46.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.178+0000 7f40a2ea2700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f408008e8b0 0x7f4080090d60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f409400dae0 tx=0x7f40940078c0 comp rx=0 tx=0).stop 2023-09-30T02:00:46.182 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.178+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f409c13d490 msgr2=0x7f409c0adb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.178+0000 7f40a2ea2700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f409c13d490 0x7f409c0adb00 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f409800c510 tx=0x7f4098007e60 comp rx=0 tx=0).stop 2023-09-30T02:00:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.178+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1896139610 shutdown_connections 2023-09-30T02:00:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.178+0000 7f40a2ea2700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f409c13d490 0x7f409c0adb00 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.178+0000 7f40a2ea2700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f409c0702f0 0x7f409c153920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.178+0000 7f40a2ea2700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f408008e8b0 0x7f4080090d60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.178+0000 7f40a2ea2700 1 --2- 172.21.15.55:0/1896139610 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f409c06ff20 0x7f409c13bc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.178+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1896139610 >> 172.21.15.55:0/1896139610 conn(0x7f409c0b2cf0 msgr2=0x7f409c13cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.178+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1896139610 shutdown_connections 2023-09-30T02:00:46.183 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:46.178+0000 7f40a2ea2700 1 -- 172.21.15.55:0/1896139610 wait complete. 2023-09-30T02:00:49.199 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:49.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f299d149700 1 Processor -- start 2023-09-30T02:00:49.316 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f299d149700 1 -- start start 2023-09-30T02:00:49.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f299d149700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2998135dd0 0x7f29981361d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:49.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f299d149700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f299809f930 0x7f299809fd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:49.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f299d149700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29980a4f90 con 0x7f29980a4bc0 2023-09-30T02:00:49.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f299d149700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2998136710 con 0x7f2998135dd0 2023-09-30T02:00:49.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f299d149700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29980a0810 con 0x7f299809f930 2023-09-30T02:00:49.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f29977fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2998135dd0 0x7f29981361d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:49.317 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f29977fe700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f2998135dd0 0x7f29981361d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:45560/0 (socket says 172.21.15.55:45560) 2023-09-30T02:00:49.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f29977fe700 1 -- 172.21.15.55:0/797335442 learned_addr learned my addr 172.21.15.55:0/797335442 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:49.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f299c948700 1 --2- 172.21.15.55:0/797335442 >> v2:172.21.15.133:3300/0 conn(0x7f299809f930 0x7f299809fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:49.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f29977fe700 1 -- 172.21.15.55:0/797335442 >> v2:172.21.15.133:3300/0 conn(0x7f299809f930 msgr2=0x7f299809fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:49.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f29977fe700 1 --2- 172.21.15.55:0/797335442 >> v2:172.21.15.133:3300/0 conn(0x7f299809f930 0x7f299809fd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:49.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f29977fe700 1 -- 172.21.15.55:0/797335442 >> v1:172.21.15.133:6789/0 conn(0x7f29980a4bc0 legacy=0x7f299806b590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:49.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.310+0000 7f29977fe700 1 -- 172.21.15.55:0/797335442 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29980a0ad0 con 0x7f2998135dd0 2023-09-30T02:00:49.318 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.314+0000 7f29977fe700 1 --2- 172.21.15.55:0/797335442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2998135dd0 0x7f29981361d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f299806e300 tx=0x7f2988009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58dd9cec975dc39d server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:49.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.314+0000 7f2996ffd700 1 -- 172.21.15.55:0/797335442 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298800e070 con 0x7f2998135dd0 2023-09-30T02:00:49.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.314+0000 7f2996ffd700 1 -- 172.21.15.55:0/797335442 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298800ba10 con 0x7f2998135dd0 2023-09-30T02:00:49.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.314+0000 7f2996ffd700 1 -- 172.21.15.55:0/797335442 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29880092e0 con 0x7f2998135dd0 2023-09-30T02:00:49.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.314+0000 7f299d149700 1 -- 172.21.15.55:0/797335442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2998135dd0 msgr2=0x7f29981361d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:49.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.314+0000 7f299d149700 1 --2- 172.21.15.55:0/797335442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2998135dd0 0x7f29981361d0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f299806e300 tx=0x7f2988009840 comp rx=0 tx=0).stop 2023-09-30T02:00:49.319 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.314+0000 7f299d149700 1 -- 172.21.15.55:0/797335442 shutdown_connections 2023-09-30T02:00:49.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.314+0000 7f299d149700 1 --2- 172.21.15.55:0/797335442 >> v2:172.21.15.133:3300/0 conn(0x7f299809f930 0x7f299809fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:49.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.314+0000 7f299d149700 1 --2- 172.21.15.55:0/797335442 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f2998135dd0 0x7f29981361d0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:49.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.314+0000 7f299d149700 1 -- 172.21.15.55:0/797335442 >> 172.21.15.55:0/797335442 conn(0x7f29980b23d0 msgr2=0x7f29980b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:49.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.314+0000 7f299d149700 1 -- 172.21.15.55:0/797335442 shutdown_connections 2023-09-30T02:00:49.320 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.314+0000 7f299d149700 1 -- 172.21.15.55:0/797335442 wait complete. 2023-09-30T02:00:49.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299d149700 1 Processor -- start 2023-09-30T02:00:49.322 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299d149700 1 -- start start 2023-09-30T02:00:49.326 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299d149700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299809f930 0x7f299809e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:49.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299d149700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29980a4bc0 0x7f29980a9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:49.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299d149700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2998135dd0 0x7f2998153950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:49.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299d149700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2998152e80 con 0x7f29980a4bc0 2023-09-30T02:00:49.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299d149700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29981534c0 con 0x7f299809f930 2023-09-30T02:00:49.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299d149700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2998144aa0 con 0x7f2998135dd0 2023-09-30T02:00:49.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299c948700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2998135dd0 0x7f2998153950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:49.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f29977fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29980a4bc0 0x7f29980a9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:49.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299c948700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2998135dd0 0x7f2998153950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:33376/0 (socket says 172.21.15.55:33376) 2023-09-30T02:00:49.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299c948700 1 -- 172.21.15.55:0/2134332478 learned_addr learned my addr 172.21.15.55:0/2134332478 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:49.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f2997fff700 1 --2- 172.21.15.55:0/2134332478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299809f930 0x7f299809e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:49.327 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299c948700 1 -- 172.21.15.55:0/2134332478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299809f930 msgr2=0x7f299809e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299c948700 1 --2- 172.21.15.55:0/2134332478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299809f930 0x7f299809e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299c948700 1 -- 172.21.15.55:0/2134332478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29980a4bc0 msgr2=0x7f29980a9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299c948700 1 --2- 172.21.15.55:0/2134332478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29980a4bc0 0x7f29980a9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299c948700 1 -- 172.21.15.55:0/2134332478 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2988009ae0 con 0x7f2998135dd0 2023-09-30T02:00:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f2997fff700 1 --2- 172.21.15.55:0/2134332478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299809f930 0x7f299809e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T02:00:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299c948700 1 --2- 172.21.15.55:0/2134332478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2998135dd0 0x7f2998153950 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f299000d890 tx=0x7f2990008040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f297ffff700 1 -- 172.21.15.55:0/2134332478 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29900125f0 con 0x7f2998135dd0 2023-09-30T02:00:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f297ffff700 1 -- 172.21.15.55:0/2134332478 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2990012770 con 0x7f2998135dd0 2023-09-30T02:00:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f299d149700 1 -- 172.21.15.55:0/2134332478 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2998144d60 con 0x7f2998135dd0 2023-09-30T02:00:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.318+0000 7f297ffff700 1 -- 172.21.15.55:0/2134332478 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2990012b30 con 0x7f2998135dd0 2023-09-30T02:00:49.328 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.322+0000 7f299d149700 1 -- 172.21.15.55:0/2134332478 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2998153fa0 con 0x7f2998135dd0 2023-09-30T02:00:49.329 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.322+0000 7f299d149700 1 -- 172.21.15.55:0/2134332478 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2998144870 con 0x7f2998135dd0 2023-09-30T02:00:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.326+0000 7f297ffff700 1 -- 172.21.15.55:0/2134332478 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f299001e460 con 0x7f2998135dd0 2023-09-30T02:00:49.330 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.326+0000 7f297ffff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:49.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.326+0000 7f297ffff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:49.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.326+0000 7f297ffff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:49.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.326+0000 7f297ffff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:49.331 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.326+0000 7f297ffff700 1 --2- 172.21.15.55:0/2134332478 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f298408e8b0 0x7f2984090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:49.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.326+0000 7f2997fff700 1 --2- 172.21.15.55:0/2134332478 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f298408e8b0 0x7f2984090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:49.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.326+0000 7f297ffff700 1 -- 172.21.15.55:0/2134332478 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f29900b5920 con 0x7f2998135dd0 2023-09-30T02:00:49.332 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.326+0000 7f2997fff700 1 --2- 172.21.15.55:0/2134332478 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f298408e8b0 0x7f2984090d60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f298c007fd0 tx=0x7f298c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:49.336 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.330+0000 7f297ffff700 1 -- 172.21.15.55:0/2134332478 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f2990089d40 con 0x7f2998135dd0 2023-09-30T02:00:49.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.526+0000 7f299d149700 1 -- 172.21.15.55:0/2134332478 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f2998064440 con 0x7f2998135dd0 2023-09-30T02:00:49.532 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.526+0000 7f297ffff700 1 -- 172.21.15.55:0/2134332478 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f29900898d0 con 0x7f2998135dd0 2023-09-30T02:00:49.532 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:49.533 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.530+0000 7f299d149700 10 mgrc shutdown 2023-09-30T02:00:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.530+0000 7f299d149700 1 -- 172.21.15.55:0/2134332478 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f298408e8b0 msgr2=0x7f2984090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:49.536 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.530+0000 7f299d149700 1 --2- 172.21.15.55:0/2134332478 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f298408e8b0 0x7f2984090d60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f298c007fd0 tx=0x7f298c009040 comp rx=0 tx=0).stop 2023-09-30T02:00:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.530+0000 7f299d149700 1 -- 172.21.15.55:0/2134332478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2998135dd0 msgr2=0x7f2998153950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.530+0000 7f299d149700 1 --2- 172.21.15.55:0/2134332478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2998135dd0 0x7f2998153950 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f299000d890 tx=0x7f2990008040 comp rx=0 tx=0).stop 2023-09-30T02:00:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.530+0000 7f299d149700 1 -- 172.21.15.55:0/2134332478 shutdown_connections 2023-09-30T02:00:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.530+0000 7f299d149700 1 --2- 172.21.15.55:0/2134332478 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f298408e8b0 0x7f2984090d60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.530+0000 7f299d149700 1 --2- 172.21.15.55:0/2134332478 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f2998135dd0 0x7f2998153950 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.530+0000 7f299d149700 1 --2- 172.21.15.55:0/2134332478 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f29980a4bc0 0x7f29980a9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.530+0000 7f299d149700 1 --2- 172.21.15.55:0/2134332478 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f299809f930 0x7f299809e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.530+0000 7f299d149700 1 -- 172.21.15.55:0/2134332478 >> 172.21.15.55:0/2134332478 conn(0x7f29980b23d0 msgr2=0x7f2998143be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.530+0000 7f299d149700 1 -- 172.21.15.55:0/2134332478 shutdown_connections 2023-09-30T02:00:49.537 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:49.530+0000 7f299d149700 1 -- 172.21.15.55:0/2134332478 wait complete. 2023-09-30T02:00:52.552 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:52.665 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1153fff700 1 Processor -- start 2023-09-30T02:00:52.666 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1153fff700 1 -- start start 2023-09-30T02:00:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1153fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f115413d490 0x7f115406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1153fff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f115406c810 con 0x7f1154070320 2023-09-30T02:00:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1153fff700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11541409e0 con 0x7f115406ff20 2023-09-30T02:00:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1153fff700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1154140ca0 con 0x7f115413d490 2023-09-30T02:00:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1152ffd700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f115413d490 0x7f115406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f11537fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f1154070320 0x7f115414a8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34880/0 (socket says 172.21.15.55:34880) 2023-09-30T02:00:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f11537fe700 1 -- 172.21.15.55:0/4042005794 learned_addr learned my addr 172.21.15.55:0/4042005794 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T02:00:52.667 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1152ffd700 1 -- 172.21.15.55:0/4042005794 >> v1:172.21.15.133:6789/0 conn(0x7f115406ff20 legacy=0x7f115413fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:52.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1152ffd700 1 -- 172.21.15.55:0/4042005794 >> v1:172.21.15.55:6789/0 conn(0x7f1154070320 legacy=0x7f115414a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:52.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1151ffb700 1 -- 172.21.15.55:0/4042005794 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2194454954 0 0) 0x7f115406c810 con 0x7f1154070320 2023-09-30T02:00:52.668 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1152ffd700 1 -- 172.21.15.55:0/4042005794 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f115406ccb0 con 0x7f115413d490 2023-09-30T02:00:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1152ffd700 1 --2- 172.21.15.55:0/4042005794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115413d490 0x7f115406c2d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1154140bd0 tx=0x7f113c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ec3f886ed0f6fd server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1151ffb700 1 -- 172.21.15.55:0/4042005794 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c015070 con 0x7f115413d490 2023-09-30T02:00:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1151ffb700 1 -- 172.21.15.55:0/4042005794 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f113c005c10 con 0x7f115413d490 2023-09-30T02:00:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1151ffb700 1 -- 172.21.15.55:0/4042005794 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f113c006030 con 0x7f115413d490 2023-09-30T02:00:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1153fff700 1 -- 172.21.15.55:0/4042005794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115413d490 msgr2=0x7f115406c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1153fff700 1 --2- 172.21.15.55:0/4042005794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115413d490 0x7f115406c2d0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f1154140bd0 tx=0x7f113c009120 comp rx=0 tx=0).stop 2023-09-30T02:00:52.669 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1153fff700 1 -- 172.21.15.55:0/4042005794 shutdown_connections 2023-09-30T02:00:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1153fff700 1 --2- 172.21.15.55:0/4042005794 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115413d490 0x7f115406c2d0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1153fff700 1 -- 172.21.15.55:0/4042005794 >> 172.21.15.55:0/4042005794 conn(0x7f11540b2cf0 msgr2=0x7f11540b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1153fff700 1 -- 172.21.15.55:0/4042005794 shutdown_connections 2023-09-30T02:00:52.670 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.662+0000 7f1153fff700 1 -- 172.21.15.55:0/4042005794 wait complete. 2023-09-30T02:00:52.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.666+0000 7f1153fff700 1 Processor -- start 2023-09-30T02:00:52.671 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.666+0000 7f1153fff700 1 -- start start 2023-09-30T02:00:52.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.666+0000 7f1153fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115406ff20 0x7f11540aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:52.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.666+0000 7f1153fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1154070320 0x7f1154150210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:52.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.666+0000 7f1153fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f115413d490 0x7f1154142d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:52.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.666+0000 7f1153fff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11541507e0 con 0x7f115406ff20 2023-09-30T02:00:52.674 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.666+0000 7f1153fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1154151410 con 0x7f1154070320 2023-09-30T02:00:52.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.666+0000 7f1153fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11541509c0 con 0x7f115413d490 2023-09-30T02:00:52.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.666+0000 7f11537fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f115413d490 0x7f1154142d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:52.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.666+0000 7f1152ffd700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115406ff20 0x7f11540aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:52.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.666+0000 7f11537fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f115413d490 0x7f1154142d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:59184/0 (socket says 172.21.15.55:59184) 2023-09-30T02:00:52.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.666+0000 7f11537fe700 1 -- 172.21.15.55:0/1597708288 learned_addr learned my addr 172.21.15.55:0/1597708288 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:52.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.666+0000 7f11527fc700 1 --2- 172.21.15.55:0/1597708288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1154070320 0x7f1154150210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:52.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.670+0000 7f11537fe700 1 -- 172.21.15.55:0/1597708288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1154070320 msgr2=0x7f1154150210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:52.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.670+0000 7f11537fe700 1 --2- 172.21.15.55:0/1597708288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1154070320 0x7f1154150210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:52.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.670+0000 7f11537fe700 1 -- 172.21.15.55:0/1597708288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115406ff20 msgr2=0x7f11540aebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:52.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.670+0000 7f11537fe700 1 --2- 172.21.15.55:0/1597708288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115406ff20 0x7f11540aebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:52.675 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.670+0000 7f11537fe700 1 -- 172.21.15.55:0/1597708288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f113c0093c0 con 0x7f115413d490 2023-09-30T02:00:52.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.670+0000 7f1152ffd700 1 --2- 172.21.15.55:0/1597708288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115406ff20 0x7f11540aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T02:00:52.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.670+0000 7f11537fe700 1 --2- 172.21.15.55:0/1597708288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f115413d490 0x7f1154142d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f114c00cc10 tx=0x7f114c0019e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:52.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.670+0000 7f114affd700 1 -- 172.21.15.55:0/1597708288 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c00a8b0 con 0x7f115413d490 2023-09-30T02:00:52.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.670+0000 7f114affd700 1 -- 172.21.15.55:0/1597708288 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f114c00aa30 con 0x7f115413d490 2023-09-30T02:00:52.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.670+0000 7f1153fff700 1 -- 172.21.15.55:0/1597708288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1154150c80 con 0x7f115413d490 2023-09-30T02:00:52.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.670+0000 7f114affd700 1 -- 172.21.15.55:0/1597708288 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f114c00adf0 con 0x7f115413d490 2023-09-30T02:00:52.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.670+0000 7f1153fff700 1 -- 172.21.15.55:0/1597708288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1154143c10 con 0x7f115413d490 2023-09-30T02:00:52.676 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.670+0000 7f1153fff700 1 -- 172.21.15.55:0/1597708288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1154064440 con 0x7f115413d490 2023-09-30T02:00:52.677 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.674+0000 7f114affd700 1 -- 172.21.15.55:0/1597708288 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f114c007300 con 0x7f115413d490 2023-09-30T02:00:52.678 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.674+0000 7f114affd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:52.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.674+0000 7f114affd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:52.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.674+0000 7f114affd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:52.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.674+0000 7f114affd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:52.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.674+0000 7f114affd700 1 --2- 172.21.15.55:0/1597708288 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f113408e8b0 0x7f1134090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:52.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.674+0000 7f114affd700 1 -- 172.21.15.55:0/1597708288 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f114c0b56a0 con 0x7f115413d490 2023-09-30T02:00:52.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.674+0000 7f1152ffd700 1 --2- 172.21.15.55:0/1597708288 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f113408e8b0 0x7f1134090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:52.679 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.674+0000 7f1152ffd700 1 --2- 172.21.15.55:0/1597708288 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f113408e8b0 0x7f1134090d60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f113c009390 tx=0x7f113c015000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:52.683 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.678+0000 7f114affd700 1 -- 172.21.15.55:0/1597708288 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f114c085fa0 con 0x7f115413d490 2023-09-30T02:00:52.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.878+0000 7f1153fff700 1 -- 172.21.15.55:0/1597708288 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f1154068100 con 0x7f115413d490 2023-09-30T02:00:52.885 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.882+0000 7f114affd700 1 -- 172.21.15.55:0/1597708288 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f114c0895c0 con 0x7f115413d490 2023-09-30T02:00:52.885 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:52.886 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:52.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.886+0000 7f1153fff700 10 mgrc shutdown 2023-09-30T02:00:52.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.886+0000 7f1153fff700 1 -- 172.21.15.55:0/1597708288 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f113408e8b0 msgr2=0x7f1134090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:52.890 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.886+0000 7f1153fff700 1 --2- 172.21.15.55:0/1597708288 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f113408e8b0 0x7f1134090d60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f113c009390 tx=0x7f113c015000 comp rx=0 tx=0).stop 2023-09-30T02:00:52.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.886+0000 7f1153fff700 1 -- 172.21.15.55:0/1597708288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f115413d490 msgr2=0x7f1154142d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:52.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.886+0000 7f1153fff700 1 --2- 172.21.15.55:0/1597708288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f115413d490 0x7f1154142d80 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f114c00cc10 tx=0x7f114c0019e0 comp rx=0 tx=0).stop 2023-09-30T02:00:52.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.886+0000 7f1153fff700 1 -- 172.21.15.55:0/1597708288 shutdown_connections 2023-09-30T02:00:52.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.886+0000 7f1153fff700 1 --2- 172.21.15.55:0/1597708288 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f113408e8b0 0x7f1134090d60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:52.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.886+0000 7f1153fff700 1 --2- 172.21.15.55:0/1597708288 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f115413d490 0x7f1154142d80 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:52.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.886+0000 7f1153fff700 1 --2- 172.21.15.55:0/1597708288 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f1154070320 0x7f1154150210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:52.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.886+0000 7f1153fff700 1 --2- 172.21.15.55:0/1597708288 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f115406ff20 0x7f11540aebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:52.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.886+0000 7f1153fff700 1 -- 172.21.15.55:0/1597708288 >> 172.21.15.55:0/1597708288 conn(0x7f11540b2cf0 msgr2=0x7f115406d200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:52.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.886+0000 7f1153fff700 1 -- 172.21.15.55:0/1597708288 shutdown_connections 2023-09-30T02:00:52.891 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:52.886+0000 7f1153fff700 1 -- 172.21.15.55:0/1597708288 wait complete. 2023-09-30T02:00:55.907 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:56.019 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.018+0000 7f733644f700 1 Processor -- start 2023-09-30T02:00:56.020 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.018+0000 7f733644f700 1 -- start start 2023-09-30T02:00:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.018+0000 7f733644f700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f73300b3060 0x7f73300a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.018+0000 7f733644f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73300a7f20 0x7f733013ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.018+0000 7f733644f700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73300b3430 con 0x7f733013e5f0 2023-09-30T02:00:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.018+0000 7f733644f700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f733013b8f0 con 0x7f73300b3060 2023-09-30T02:00:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.018+0000 7f733644f700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73300a4b60 con 0x7f73300a7f20 2023-09-30T02:00:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.018+0000 7f73349ec700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73300a7f20 0x7f733013ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:56.021 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.018+0000 7f732f7fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f733013e5f0 0x7f73300a7810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34884/0 (socket says 172.21.15.55:34884) 2023-09-30T02:00:56.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.018+0000 7f732f7fe700 1 -- 172.21.15.55:0/285624419 learned_addr learned my addr 172.21.15.55:0/285624419 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T02:00:56.022 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.018+0000 7f732ffff700 1 --2- 172.21.15.55:0/285624419 >> v2:172.21.15.133:3300/0 conn(0x7f73300b3060 0x7f73300a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:56.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.018+0000 7f732effd700 1 -- 172.21.15.55:0/285624419 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326399469 0 0) 0x7f73300b3430 con 0x7f733013e5f0 2023-09-30T02:00:56.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.018+0000 7f732effd700 1 -- 172.21.15.55:0/285624419 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7318003570 con 0x7f733013e5f0 2023-09-30T02:00:56.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f732ffff700 1 -- 172.21.15.55:0/285624419 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73300a7f20 msgr2=0x7f733013ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:00:56.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f732ffff700 1 --2- 172.21.15.55:0/285624419 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73300a7f20 0x7f733013ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:56.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f732ffff700 1 -- 172.21.15.55:0/285624419 >> v1:172.21.15.55:6789/0 conn(0x7f733013e5f0 legacy=0x7f73300a7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:56.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f732effd700 1 -- 172.21.15.55:0/285624419 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 284358085 0 0) 0x7f7318003570 con 0x7f733013e5f0 2023-09-30T02:00:56.024 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f732ffff700 1 -- 172.21.15.55:0/285624419 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f733013dfa0 con 0x7f73300b3060 2023-09-30T02:00:56.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f732ffff700 1 --2- 172.21.15.55:0/285624419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73300b3060 0x7f73300a6120 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7320009e60 tx=0x7f7320009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1a67562b82f787cf server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:56.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f732effd700 1 -- 172.21.15.55:0/285624419 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7324001470 con 0x7f73300b3060 2023-09-30T02:00:56.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f732effd700 1 -- 172.21.15.55:0/285624419 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f732000b7a0 con 0x7f73300b3060 2023-09-30T02:00:56.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f732effd700 1 -- 172.21.15.55:0/285624419 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f732000bb20 con 0x7f73300b3060 2023-09-30T02:00:56.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 -- 172.21.15.55:0/285624419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73300b3060 msgr2=0x7f73300a6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:56.025 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 --2- 172.21.15.55:0/285624419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73300b3060 0x7f73300a6120 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7320009e60 tx=0x7f7320009780 comp rx=0 tx=0).stop 2023-09-30T02:00:56.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 -- 172.21.15.55:0/285624419 shutdown_connections 2023-09-30T02:00:56.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 --2- 172.21.15.55:0/285624419 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73300a7f20 0x7f733013ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:56.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 --2- 172.21.15.55:0/285624419 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f73300b3060 0x7f73300a6120 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:56.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 -- 172.21.15.55:0/285624419 >> 172.21.15.55:0/285624419 conn(0x7f7330068b00 msgr2=0x7f73300b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:56.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 -- 172.21.15.55:0/285624419 shutdown_connections 2023-09-30T02:00:56.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 -- 172.21.15.55:0/285624419 wait complete. 2023-09-30T02:00:56.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 Processor -- start 2023-09-30T02:00:56.026 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 -- start start 2023-09-30T02:00:56.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73300a7f20 0x7f73300aa240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:56.028 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300b3060 0x7f73300aa780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:56.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f733013e5f0 0x7f733006bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:56.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73300aacc0 con 0x7f73300b3060 2023-09-30T02:00:56.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73300a8dc0 con 0x7f733013e5f0 2023-09-30T02:00:56.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f733644f700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f733014bab0 con 0x7f73300a7f20 2023-09-30T02:00:56.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f732f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300b3060 0x7f73300aa780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:56.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f732ffff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73300a7f20 0x7f73300aa240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:56.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f732f7fe700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300b3060 0x7f73300aa780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:44460/0 (socket says 172.21.15.55:44460) 2023-09-30T02:00:56.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f732f7fe700 1 -- 172.21.15.55:0/740487313 learned_addr learned my addr 172.21.15.55:0/740487313 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:56.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.022+0000 7f73349ec700 1 --2- 172.21.15.55:0/740487313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f733013e5f0 0x7f733006bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:56.029 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.026+0000 7f732f7fe700 1 -- 172.21.15.55:0/740487313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73300a7f20 msgr2=0x7f73300aa240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:56.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.026+0000 7f732f7fe700 1 --2- 172.21.15.55:0/740487313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73300a7f20 0x7f73300aa240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:56.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.026+0000 7f732f7fe700 1 -- 172.21.15.55:0/740487313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f733013e5f0 msgr2=0x7f733006bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:56.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.026+0000 7f732f7fe700 1 --2- 172.21.15.55:0/740487313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f733013e5f0 0x7f733006bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:56.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.026+0000 7f732f7fe700 1 -- 172.21.15.55:0/740487313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7320009a20 con 0x7f73300b3060 2023-09-30T02:00:56.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.026+0000 7f732f7fe700 1 --2- 172.21.15.55:0/740487313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300b3060 0x7f73300aa780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f732400cb90 tx=0x7f7324001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:56.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.026+0000 7f7317fff700 1 -- 172.21.15.55:0/740487313 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7324001d60 con 0x7f73300b3060 2023-09-30T02:00:56.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.026+0000 7f7317fff700 1 -- 172.21.15.55:0/740487313 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7324007360 con 0x7f73300b3060 2023-09-30T02:00:56.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.026+0000 7f7317fff700 1 -- 172.21.15.55:0/740487313 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7324007700 con 0x7f73300b3060 2023-09-30T02:00:56.030 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.026+0000 7f733644f700 1 -- 172.21.15.55:0/740487313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f733014bd70 con 0x7f73300b3060 2023-09-30T02:00:56.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.026+0000 7f733644f700 1 -- 172.21.15.55:0/740487313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f733006d130 con 0x7f73300b3060 2023-09-30T02:00:56.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.026+0000 7f733644f700 1 -- 172.21.15.55:0/740487313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73300a8f80 con 0x7f73300b3060 2023-09-30T02:00:56.031 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.030+0000 7f7317fff700 1 -- 172.21.15.55:0/740487313 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f7324004a40 con 0x7f73300b3060 2023-09-30T02:00:56.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.030+0000 7f7317fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:56.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.030+0000 7f7317fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:56.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.030+0000 7f7317fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:56.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.030+0000 7f7317fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:56.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.030+0000 7f7317fff700 1 --2- 172.21.15.55:0/740487313 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f731c08e8b0 0x7f731c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:56.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.030+0000 7f732ffff700 1 --2- 172.21.15.55:0/740487313 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f731c08e8b0 0x7f731c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:56.032 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.030+0000 7f7317fff700 1 -- 172.21.15.55:0/740487313 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f73240b4080 con 0x7f73300b3060 2023-09-30T02:00:56.033 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.030+0000 7f732ffff700 1 --2- 172.21.15.55:0/740487313 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f731c08e8b0 0x7f731c090d60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f73200097c0 tx=0x7f732001a000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:56.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.038+0000 7f7317fff700 1 -- 172.21.15.55:0/740487313 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f7324084ab0 con 0x7f73300b3060 2023-09-30T02:00:56.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.238+0000 7f733644f700 1 -- 172.21.15.55:0/740487313 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f733006d410 con 0x7f73300b3060 2023-09-30T02:00:56.238 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.238+0000 7f7317fff700 1 -- 172.21.15.55:0/740487313 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f7324018100 con 0x7f73300b3060 2023-09-30T02:00:56.238 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:56.239 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:56.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.238+0000 7f733644f700 10 mgrc shutdown 2023-09-30T02:00:56.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.238+0000 7f733644f700 1 -- 172.21.15.55:0/740487313 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f731c08e8b0 msgr2=0x7f731c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:56.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.238+0000 7f733644f700 1 --2- 172.21.15.55:0/740487313 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f731c08e8b0 0x7f731c090d60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f73200097c0 tx=0x7f732001a000 comp rx=0 tx=0).stop 2023-09-30T02:00:56.241 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.238+0000 7f733644f700 1 -- 172.21.15.55:0/740487313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300b3060 msgr2=0x7f73300aa780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:56.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.238+0000 7f733644f700 1 --2- 172.21.15.55:0/740487313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300b3060 0x7f73300aa780 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f732400cb90 tx=0x7f7324001ad0 comp rx=0 tx=0).stop 2023-09-30T02:00:56.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.238+0000 7f733644f700 1 -- 172.21.15.55:0/740487313 shutdown_connections 2023-09-30T02:00:56.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.238+0000 7f733644f700 1 --2- 172.21.15.55:0/740487313 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f733013e5f0 0x7f733006bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:56.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.238+0000 7f733644f700 1 --2- 172.21.15.55:0/740487313 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f73300b3060 0x7f73300aa780 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:56.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.238+0000 7f733644f700 1 --2- 172.21.15.55:0/740487313 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f731c08e8b0 0x7f731c090d60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:56.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.238+0000 7f733644f700 1 --2- 172.21.15.55:0/740487313 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f73300a7f20 0x7f73300aa240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:56.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.238+0000 7f733644f700 1 -- 172.21.15.55:0/740487313 >> 172.21.15.55:0/740487313 conn(0x7f7330068b00 msgr2=0x7f733013c240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:56.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.242+0000 7f733644f700 1 -- 172.21.15.55:0/740487313 shutdown_connections 2023-09-30T02:00:56.242 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:56.242+0000 7f733644f700 1 -- 172.21.15.55:0/740487313 wait complete. 2023-09-30T02:00:59.254 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:00:59.368 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.366+0000 7f851f365700 1 Processor -- start 2023-09-30T02:00:59.369 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.366+0000 7f851f365700 1 -- start start 2023-09-30T02:00:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851f365700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f85180a0d80 0x7f85180a4a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851f365700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851809f480 con 0x7f851813e6f0 2023-09-30T02:00:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851f365700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851809f740 con 0x7f85180a1150 2023-09-30T02:00:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851f365700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851806e040 con 0x7f85180a0d80 2023-09-30T02:00:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851e363700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f85180a0d80 0x7f85180a4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851eb64700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f851813e6f0 0x7f8518148400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:34892/0 (socket says 172.21.15.55:34892) 2023-09-30T02:00:59.370 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851eb64700 1 -- 172.21.15.55:0/2565437438 learned_addr learned my addr 172.21.15.55:0/2565437438 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T02:00:59.377 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851d361700 1 -- 172.21.15.55:0/2565437438 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821852062 0 0) 0x7f851809f480 con 0x7f851813e6f0 2023-09-30T02:00:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851e363700 1 -- 172.21.15.55:0/2565437438 >> v1:172.21.15.133:6789/0 conn(0x7f85180a1150 legacy=0x7f851813dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851e363700 1 -- 172.21.15.55:0/2565437438 >> v1:172.21.15.55:6789/0 conn(0x7f851813e6f0 legacy=0x7f8518148400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851e363700 1 -- 172.21.15.55:0/2565437438 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85180a2240 con 0x7f85180a0d80 2023-09-30T02:00:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851e363700 1 --2- 172.21.15.55:0/2565437438 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f85180a0d80 0x7f85180a4a90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8514009910 tx=0x7f85140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c5dce9e13d8d197c server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:59.378 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851d361700 1 -- 172.21.15.55:0/2565437438 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851400b860 con 0x7f85180a0d80 2023-09-30T02:00:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851d361700 1 -- 172.21.15.55:0/2565437438 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851400b9c0 con 0x7f85180a0d80 2023-09-30T02:00:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851d361700 1 -- 172.21.15.55:0/2565437438 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851400bd60 con 0x7f85180a0d80 2023-09-30T02:00:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851f365700 1 -- 172.21.15.55:0/2565437438 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f85180a0d80 msgr2=0x7f85180a4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851f365700 1 --2- 172.21.15.55:0/2565437438 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f85180a0d80 0x7f85180a4a90 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f8514009910 tx=0x7f85140091a0 comp rx=0 tx=0).stop 2023-09-30T02:00:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851f365700 1 -- 172.21.15.55:0/2565437438 shutdown_connections 2023-09-30T02:00:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851f365700 1 --2- 172.21.15.55:0/2565437438 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f85180a0d80 0x7f85180a4a90 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:59.379 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851f365700 1 -- 172.21.15.55:0/2565437438 >> 172.21.15.55:0/2565437438 conn(0x7f85180b23d0 msgr2=0x7f85180b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851f365700 1 -- 172.21.15.55:0/2565437438 shutdown_connections 2023-09-30T02:00:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851f365700 1 -- 172.21.15.55:0/2565437438 wait complete. 2023-09-30T02:00:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851f365700 1 Processor -- start 2023-09-30T02:00:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.370+0000 7f851f365700 1 -- start start 2023-09-30T02:00:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851f365700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85180a0d80 0x7f851806aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851f365700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f85180a1150 0x7f85180a67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851f365700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f851813e6f0 0x7f85180a6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:59.380 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851f365700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8518153660 con 0x7f85180a0d80 2023-09-30T02:00:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851f365700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851806b330 con 0x7f851813e6f0 2023-09-30T02:00:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851f365700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851806b5f0 con 0x7f85180a1150 2023-09-30T02:00:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851e363700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85180a0d80 0x7f851806aac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851db62700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f85180a1150 0x7f85180a67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851db62700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f85180a1150 0x7f85180a67a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:59228/0 (socket says 172.21.15.55:59228) 2023-09-30T02:00:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851db62700 1 -- 172.21.15.55:0/1287485250 learned_addr learned my addr 172.21.15.55:0/1287485250 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:00:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851eb64700 1 --2- 172.21.15.55:0/1287485250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f851813e6f0 0x7f85180a6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:59.381 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851db62700 1 -- 172.21.15.55:0/1287485250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f851813e6f0 msgr2=0x7f85180a6ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851db62700 1 --2- 172.21.15.55:0/1287485250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f851813e6f0 0x7f85180a6ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851db62700 1 -- 172.21.15.55:0/1287485250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85180a0d80 msgr2=0x7f851806aac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851db62700 1 --2- 172.21.15.55:0/1287485250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85180a0d80 0x7f851806aac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851db62700 1 -- 172.21.15.55:0/1287485250 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8514009420 con 0x7f85180a1150 2023-09-30T02:00:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851e363700 1 --2- 172.21.15.55:0/1287485250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85180a0d80 0x7f851806aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T02:00:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851db62700 1 --2- 172.21.15.55:0/1287485250 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f85180a1150 0x7f85180a67a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f850c00c590 tx=0x7f850c00c8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:59.382 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f850a7fc700 1 -- 172.21.15.55:0/1287485250 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c011590 con 0x7f85180a1150 2023-09-30T02:00:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f850a7fc700 1 -- 172.21.15.55:0/1287485250 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c011710 con 0x7f85180a1150 2023-09-30T02:00:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851f365700 1 -- 172.21.15.55:0/1287485250 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851806b000 con 0x7f85180a1150 2023-09-30T02:00:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f850a7fc700 1 -- 172.21.15.55:0/1287485250 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c011ad0 con 0x7f85180a1150 2023-09-30T02:00:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851f365700 1 -- 172.21.15.55:0/1287485250 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851806c510 con 0x7f85180a1150 2023-09-30T02:00:59.383 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.374+0000 7f851f365700 1 -- 172.21.15.55:0/1287485250 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85181537d0 con 0x7f85180a1150 2023-09-30T02:00:59.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.378+0000 7f850a7fc700 1 -- 172.21.15.55:0/1287485250 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f850c01b3b0 con 0x7f85180a1150 2023-09-30T02:00:59.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.378+0000 7f850a7fc700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:00:59.385 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.378+0000 7f850a7fc700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:00:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.378+0000 7f850a7fc700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.378+0000 7f850a7fc700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:00:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.378+0000 7f850a7fc700 1 --2- 172.21.15.55:0/1287485250 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f84fc08e8b0 0x7f84fc090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:00:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.378+0000 7f851e363700 1 --2- 172.21.15.55:0/1287485250 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f84fc08e8b0 0x7f84fc090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:00:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.378+0000 7f850a7fc700 1 -- 172.21.15.55:0/1287485250 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f850c0b3d80 con 0x7f85180a1150 2023-09-30T02:00:59.386 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.378+0000 7f851e363700 1 --2- 172.21.15.55:0/1287485250 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f84fc08e8b0 0x7f84fc090d60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f85140093f0 tx=0x7f8514017000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:00:59.387 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.382+0000 7f850a7fc700 1 -- 172.21.15.55:0/1287485250 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f850c084680 con 0x7f85180a1150 2023-09-30T02:00:59.580 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.578+0000 7f851f365700 1 -- 172.21.15.55:0/1287485250 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f8518064440 con 0x7f85180a1150 2023-09-30T02:00:59.581 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.578+0000 7f850a7fc700 1 -- 172.21.15.55:0/1287485250 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f850c017070 con 0x7f85180a1150 2023-09-30T02:00:59.581 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:00:59.582 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:00:59.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.582+0000 7f851f365700 10 mgrc shutdown 2023-09-30T02:00:59.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.582+0000 7f851f365700 1 -- 172.21.15.55:0/1287485250 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f84fc08e8b0 msgr2=0x7f84fc090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:59.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.582+0000 7f851f365700 1 --2- 172.21.15.55:0/1287485250 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f84fc08e8b0 0x7f84fc090d60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f85140093f0 tx=0x7f8514017000 comp rx=0 tx=0).stop 2023-09-30T02:00:59.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.582+0000 7f851f365700 1 -- 172.21.15.55:0/1287485250 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f85180a1150 msgr2=0x7f85180a67a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:00:59.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.582+0000 7f851f365700 1 --2- 172.21.15.55:0/1287485250 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f85180a1150 0x7f85180a67a0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f850c00c590 tx=0x7f850c00c8a0 comp rx=0 tx=0).stop 2023-09-30T02:00:59.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.582+0000 7f851f365700 1 -- 172.21.15.55:0/1287485250 shutdown_connections 2023-09-30T02:00:59.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.582+0000 7f851f365700 1 --2- 172.21.15.55:0/1287485250 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f851813e6f0 0x7f85180a6ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:59.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.582+0000 7f851f365700 1 --2- 172.21.15.55:0/1287485250 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f84fc08e8b0 0x7f84fc090d60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:59.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.582+0000 7f851f365700 1 --2- 172.21.15.55:0/1287485250 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f85180a1150 0x7f85180a67a0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:59.586 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.582+0000 7f851f365700 1 --2- 172.21.15.55:0/1287485250 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f85180a0d80 0x7f851806aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:00:59.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.582+0000 7f851f365700 1 -- 172.21.15.55:0/1287485250 >> 172.21.15.55:0/1287485250 conn(0x7f85180b23d0 msgr2=0x7f851813c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:00:59.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.586+0000 7f851f365700 1 -- 172.21.15.55:0/1287485250 shutdown_connections 2023-09-30T02:00:59.587 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:00:59.586+0000 7f851f365700 1 -- 172.21.15.55:0/1287485250 wait complete. 2023-09-30T02:01:02.603 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:01:02.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.717+0000 7f6172fe9700 1 Processor -- start 2023-09-30T02:01:02.720 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.717+0000 7f6172fe9700 1 -- start start 2023-09-30T02:01:02.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.717+0000 7f6172fe9700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f616c13d490 0x7f616c06c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:02.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.717+0000 7f6172fe9700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7f616c070320 0x7f616c14a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:02.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.717+0000 7f6172fe9700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f616c06c810 con 0x7f616c06ff20 2023-09-30T02:01:02.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.717+0000 7f6172fe9700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c1409e0 con 0x7f616c13d490 2023-09-30T02:01:02.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.717+0000 7f6172fe9700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f616c140ca0 con 0x7f616c070320 2023-09-30T02:01:02.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.717+0000 7f6171fe7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f616c13d490 0x7f616c06c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:02.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.717+0000 7f6171fe7700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7f616c13d490 0x7f616c06c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54172/0 (socket says 172.21.15.55:54172) 2023-09-30T02:01:02.721 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.717+0000 7f6171fe7700 1 -- 172.21.15.55:0/1106652550 learned_addr learned my addr 172.21.15.55:0/1106652550 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:01:02.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.717+0000 7f61727e8700 1 --2- 172.21.15.55:0/1106652550 >> v2:172.21.15.133:3300/0 conn(0x7f616c070320 0x7f616c14a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:02.722 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6171fe7700 1 -- 172.21.15.55:0/1106652550 >> v2:172.21.15.133:3300/0 conn(0x7f616c070320 msgr2=0x7f616c14a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:01:02.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6171fe7700 1 --2- 172.21.15.55:0/1106652550 >> v2:172.21.15.133:3300/0 conn(0x7f616c070320 0x7f616c14a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:02.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6171fe7700 1 -- 172.21.15.55:0/1106652550 >> v1:172.21.15.133:6789/0 conn(0x7f616c06ff20 legacy=0x7f616c13fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:02.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6171fe7700 1 -- 172.21.15.55:0/1106652550 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f616c06ccb0 con 0x7f616c13d490 2023-09-30T02:01:02.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6171fe7700 1 --2- 172.21.15.55:0/1106652550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c13d490 0x7f616c06c2d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f616c0a6110 tx=0x7f6168009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf535b4d15d43069 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:02.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6170fe5700 1 -- 172.21.15.55:0/1106652550 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6168005c10 con 0x7f616c13d490 2023-09-30T02:01:02.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6170fe5700 1 -- 172.21.15.55:0/1106652550 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6168005d70 con 0x7f616c13d490 2023-09-30T02:01:02.723 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6170fe5700 1 -- 172.21.15.55:0/1106652550 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6168006260 con 0x7f616c13d490 2023-09-30T02:01:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6172fe9700 1 -- 172.21.15.55:0/1106652550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c13d490 msgr2=0x7f616c06c2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6172fe9700 1 --2- 172.21.15.55:0/1106652550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c13d490 0x7f616c06c2d0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f616c0a6110 tx=0x7f6168009220 comp rx=0 tx=0).stop 2023-09-30T02:01:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6172fe9700 1 -- 172.21.15.55:0/1106652550 shutdown_connections 2023-09-30T02:01:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6172fe9700 1 --2- 172.21.15.55:0/1106652550 >> v2:172.21.15.133:3300/0 conn(0x7f616c070320 0x7f616c14a8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6172fe9700 1 --2- 172.21.15.55:0/1106652550 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c13d490 0x7f616c06c2d0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:02.724 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6172fe9700 1 -- 172.21.15.55:0/1106652550 >> 172.21.15.55:0/1106652550 conn(0x7f616c0b2cf0 msgr2=0x7f616c0b30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:01:02.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6172fe9700 1 -- 172.21.15.55:0/1106652550 shutdown_connections 2023-09-30T02:01:02.725 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.721+0000 7f6172fe9700 1 -- 172.21.15.55:0/1106652550 wait complete. 2023-09-30T02:01:02.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6172fe9700 1 Processor -- start 2023-09-30T02:01:02.726 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6172fe9700 1 -- start start 2023-09-30T02:01:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6172fe9700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c06ff20 0x7f616c0aeb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6172fe9700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f616c070320 0x7f616c142ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6172fe9700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c13d490 0x7f616c14f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6172fe9700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0ae6b0 con 0x7f616c06ff20 2023-09-30T02:01:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6172fe9700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0af0b0 con 0x7f616c13d490 2023-09-30T02:01:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6172fe9700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f616c0ad9f0 con 0x7f616c070320 2023-09-30T02:01:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6171fe7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c06ff20 0x7f616c0aeb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6171fe7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c06ff20 0x7f616c0aeb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54174/0 (socket says 172.21.15.55:54174) 2023-09-30T02:01:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6171fe7700 1 -- 172.21.15.55:0/2804324236 learned_addr learned my addr 172.21.15.55:0/2804324236 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:01:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f61717e6700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f616c070320 0x7f616c142ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:02.729 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f61727e8700 1 --2- 172.21.15.55:0/2804324236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c13d490 0x7f616c14f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:02.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6171fe7700 1 -- 172.21.15.55:0/2804324236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f616c070320 msgr2=0x7f616c142ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:02.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6171fe7700 1 --2- 172.21.15.55:0/2804324236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f616c070320 0x7f616c142ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:02.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6171fe7700 1 -- 172.21.15.55:0/2804324236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c13d490 msgr2=0x7f616c14f930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:02.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6171fe7700 1 --2- 172.21.15.55:0/2804324236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c13d490 0x7f616c14f930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:02.730 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6171fe7700 1 -- 172.21.15.55:0/2804324236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6168009480 con 0x7f616c06ff20 2023-09-30T02:01:02.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.725+0000 7f6171fe7700 1 --2- 172.21.15.55:0/2804324236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c06ff20 0x7f616c0aeb70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f616800b0e0 tx=0x7f6168016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:02.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.729+0000 7f6161ffb700 1 -- 172.21.15.55:0/2804324236 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616800b850 con 0x7f616c06ff20 2023-09-30T02:01:02.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.729+0000 7f6161ffb700 1 -- 172.21.15.55:0/2804324236 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6168020070 con 0x7f616c06ff20 2023-09-30T02:01:02.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.729+0000 7f6172fe9700 1 -- 172.21.15.55:0/2804324236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616c153e80 con 0x7f616c06ff20 2023-09-30T02:01:02.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.729+0000 7f6161ffb700 1 -- 172.21.15.55:0/2804324236 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f616800bbe0 con 0x7f616c06ff20 2023-09-30T02:01:02.731 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.729+0000 7f6172fe9700 1 -- 172.21.15.55:0/2804324236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616c143420 con 0x7f616c06ff20 2023-09-30T02:01:02.732 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.729+0000 7f6172fe9700 1 -- 172.21.15.55:0/2804324236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f616c064440 con 0x7f616c06ff20 2023-09-30T02:01:02.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.733+0000 7f6161ffb700 1 -- 172.21.15.55:0/2804324236 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f6168022030 con 0x7f616c06ff20 2023-09-30T02:01:02.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.733+0000 7f6161ffb700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:01:02.735 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.733+0000 7f6161ffb700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:01:02.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.733+0000 7f6161ffb700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:01:02.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.733+0000 7f6161ffb700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:01:02.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.733+0000 7f6161ffb700 1 --2- 172.21.15.55:0/2804324236 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f615008e830 0x7f6150090ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:02.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.733+0000 7f6161ffb700 1 -- 172.21.15.55:0/2804324236 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f61680b6870 con 0x7f616c06ff20 2023-09-30T02:01:02.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.733+0000 7f61717e6700 1 --2- 172.21.15.55:0/2804324236 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f615008e830 0x7f6150090ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:02.736 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.733+0000 7f61717e6700 1 --2- 172.21.15.55:0/2804324236 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f615008e830 0x7f6150090ce0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f616c13aae0 tx=0x7f615c009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:02.742 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.741+0000 7f6161ffb700 1 -- 172.21.15.55:0/2804324236 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f61680872a0 con 0x7f616c06ff20 2023-09-30T02:01:02.936 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.933+0000 7f6172fe9700 1 -- 172.21.15.55:0/2804324236 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f616c0ae7f0 con 0x7f616c06ff20 2023-09-30T02:01:02.937 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.933+0000 7f6161ffb700 1 -- 172.21.15.55:0/2804324236 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7f616808a8c0 con 0x7f616c06ff20 2023-09-30T02:01:02.937 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:01:02.937 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:01:02.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.937+0000 7f6172fe9700 10 mgrc shutdown 2023-09-30T02:01:02.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.937+0000 7f6172fe9700 1 -- 172.21.15.55:0/2804324236 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f615008e830 msgr2=0x7f6150090ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:02.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.937+0000 7f6172fe9700 1 --2- 172.21.15.55:0/2804324236 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f615008e830 0x7f6150090ce0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f616c13aae0 tx=0x7f615c009040 comp rx=0 tx=0).stop 2023-09-30T02:01:02.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.937+0000 7f6172fe9700 1 -- 172.21.15.55:0/2804324236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c06ff20 msgr2=0x7f616c0aeb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:02.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.937+0000 7f6172fe9700 1 --2- 172.21.15.55:0/2804324236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c06ff20 0x7f616c0aeb70 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f616800b0e0 tx=0x7f6168016000 comp rx=0 tx=0).stop 2023-09-30T02:01:02.940 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.937+0000 7f6172fe9700 1 -- 172.21.15.55:0/2804324236 shutdown_connections 2023-09-30T02:01:02.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.937+0000 7f6172fe9700 1 --2- 172.21.15.55:0/2804324236 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f616c13d490 0x7f616c14f930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:02.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.937+0000 7f6172fe9700 1 --2- 172.21.15.55:0/2804324236 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f615008e830 0x7f6150090ce0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:02.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.937+0000 7f6172fe9700 1 --2- 172.21.15.55:0/2804324236 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f616c070320 0x7f616c142ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:02.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.937+0000 7f6172fe9700 1 --2- 172.21.15.55:0/2804324236 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f616c06ff20 0x7f616c0aeb70 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:02.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.937+0000 7f6172fe9700 1 -- 172.21.15.55:0/2804324236 >> 172.21.15.55:0/2804324236 conn(0x7f616c0b2cf0 msgr2=0x7f616c0b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:01:02.941 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.937+0000 7f6172fe9700 1 -- 172.21.15.55:0/2804324236 shutdown_connections 2023-09-30T02:01:02.942 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:02.937+0000 7f6172fe9700 1 -- 172.21.15.55:0/2804324236 wait complete. 2023-09-30T02:01:05.953 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:01:06.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.121+0000 7fc9d3fff700 1 Processor -- start 2023-09-30T02:01:06.125 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.121+0000 7fc9d3fff700 1 -- start start 2023-09-30T02:01:06.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d3fff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc9d40a4bc0 0x7fc9d406af90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:06.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d3fff700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9d406c360 0x7fc9d406c730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:06.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d3fff700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9d40a1880 con 0x7fc9d413d060 2023-09-30T02:01:06.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d3fff700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d40a4f90 con 0x7fc9d406c360 2023-09-30T02:01:06.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d3fff700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9d40a1ab0 con 0x7fc9d40a4bc0 2023-09-30T02:01:06.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d27fc700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc9d406c360 0x7fc9d406c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:06.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d37fe700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fc9d413d060 0x7fc9d413d4c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55254/0 (socket says 172.21.15.55:55254) 2023-09-30T02:01:06.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d37fe700 1 -- 172.21.15.55:0/3057592518 learned_addr learned my addr 172.21.15.55:0/3057592518 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T02:01:06.127 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d2ffd700 1 --2- 172.21.15.55:0/3057592518 >> v2:172.21.15.133:3300/0 conn(0x7fc9d40a4bc0 0x7fc9d406af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:06.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d1ffb700 1 -- 172.21.15.55:0/3057592518 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3186107796 0 0) 0x7fc9d40a1880 con 0x7fc9d413d060 2023-09-30T02:01:06.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d1ffb700 1 -- 172.21.15.55:0/3057592518 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9bc003570 con 0x7fc9d413d060 2023-09-30T02:01:06.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d27fc700 1 -- 172.21.15.55:0/3057592518 >> v2:172.21.15.133:3300/0 conn(0x7fc9d40a4bc0 msgr2=0x7fc9d406af90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:01:06.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d27fc700 1 --2- 172.21.15.55:0/3057592518 >> v2:172.21.15.133:3300/0 conn(0x7fc9d40a4bc0 0x7fc9d406af90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:06.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d27fc700 1 -- 172.21.15.55:0/3057592518 >> v1:172.21.15.55:6789/0 conn(0x7fc9d413d060 legacy=0x7fc9d413d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:06.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d27fc700 1 -- 172.21.15.55:0/3057592518 --> v2:172.21.15.55:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9d40a1d70 con 0x7fc9d406c360 2023-09-30T02:01:06.128 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d27fc700 1 --2- 172.21.15.55:0/3057592518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d406c360 0x7fc9d406c730 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40a5430 tx=0x7fc9c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9116bd1c9392043 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:06.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d1ffb700 1 -- 172.21.15.55:0/3057592518 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4011630 con 0x7fc9d406c360 2023-09-30T02:01:06.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d1ffb700 1 -- 172.21.15.55:0/3057592518 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9c4011790 con 0x7fc9d406c360 2023-09-30T02:01:06.129 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d1ffb700 1 -- 172.21.15.55:0/3057592518 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9c4011b30 con 0x7fc9d406c360 2023-09-30T02:01:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d3fff700 1 -- 172.21.15.55:0/3057592518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d406c360 msgr2=0x7fc9d406c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d3fff700 1 --2- 172.21.15.55:0/3057592518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d406c360 0x7fc9d406c730 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fc9d40a5430 tx=0x7fc9c40091a0 comp rx=0 tx=0).stop 2023-09-30T02:01:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d3fff700 1 -- 172.21.15.55:0/3057592518 shutdown_connections 2023-09-30T02:01:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d3fff700 1 --2- 172.21.15.55:0/3057592518 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d406c360 0x7fc9d406c730 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d3fff700 1 --2- 172.21.15.55:0/3057592518 >> v2:172.21.15.133:3300/0 conn(0x7fc9d40a4bc0 0x7fc9d406af90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d3fff700 1 -- 172.21.15.55:0/3057592518 >> 172.21.15.55:0/3057592518 conn(0x7fc9d40b23d0 msgr2=0x7fc9d40b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:01:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d3fff700 1 -- 172.21.15.55:0/3057592518 shutdown_connections 2023-09-30T02:01:06.130 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.125+0000 7fc9d3fff700 1 -- 172.21.15.55:0/3057592518 wait complete. 2023-09-30T02:01:06.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d3fff700 1 Processor -- start 2023-09-30T02:01:06.131 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d3fff700 1 -- start start 2023-09-30T02:01:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d3fff700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d406c360 0x7fc9d40a3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d3fff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d40a4bc0 0x7fc9d413fd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d3fff700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9d413d060 0x7fc9d414fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:06.132 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d3fff700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d4097be0 con 0x7fc9d40a4bc0 2023-09-30T02:01:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d3fff700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d4095fb0 con 0x7fc9d406c360 2023-09-30T02:01:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d3fff700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9d4096480 con 0x7fc9d413d060 2023-09-30T02:01:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9d413d060 0x7fc9d414fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d27fc700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d40a4bc0 0x7fc9d413fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d37fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9d413d060 0x7fc9d414fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:46322/0 (socket says 172.21.15.55:46322) 2023-09-30T02:01:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d37fe700 1 -- 172.21.15.55:0/2514447813 learned_addr learned my addr 172.21.15.55:0/2514447813 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:01:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d2ffd700 1 --2- 172.21.15.55:0/2514447813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d406c360 0x7fc9d40a3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d37fe700 1 -- 172.21.15.55:0/2514447813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d406c360 msgr2=0x7fc9d40a3fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d37fe700 1 --2- 172.21.15.55:0/2514447813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d406c360 0x7fc9d40a3fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d37fe700 1 -- 172.21.15.55:0/2514447813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d40a4bc0 msgr2=0x7fc9d413fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d37fe700 1 --2- 172.21.15.55:0/2514447813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d40a4bc0 0x7fc9d413fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:06.133 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d37fe700 1 -- 172.21.15.55:0/2514447813 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c4009420 con 0x7fc9d413d060 2023-09-30T02:01:06.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d37fe700 1 --2- 172.21.15.55:0/2514447813 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9d413d060 0x7fc9d414fc40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc001460 tx=0x7fc9cc001a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:06.134 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9baffd700 1 -- 172.21.15.55:0/2514447813 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc00a870 con 0x7fc9d413d060 2023-09-30T02:01:06.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9baffd700 1 -- 172.21.15.55:0/2514447813 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9cc00a9d0 con 0x7fc9d413d060 2023-09-30T02:01:06.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d3fff700 1 -- 172.21.15.55:0/2514447813 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9d413f020 con 0x7fc9d413d060 2023-09-30T02:01:06.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9baffd700 1 -- 172.21.15.55:0/2514447813 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9cc00ad50 con 0x7fc9d413d060 2023-09-30T02:01:06.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.129+0000 7fc9d3fff700 1 -- 172.21.15.55:0/2514447813 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9d4095bf0 con 0x7fc9d413d060 2023-09-30T02:01:06.135 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.133+0000 7fc9d3fff700 1 -- 172.21.15.55:0/2514447813 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9d4064440 con 0x7fc9d413d060 2023-09-30T02:01:06.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.137+0000 7fc9baffd700 1 -- 172.21.15.55:0/2514447813 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc9cc007300 con 0x7fc9d413d060 2023-09-30T02:01:06.138 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.137+0000 7fc9baffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:01:06.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.137+0000 7fc9baffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:01:06.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.137+0000 7fc9baffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:01:06.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.137+0000 7fc9baffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:01:06.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.137+0000 7fc9baffd700 1 --2- 172.21.15.55:0/2514447813 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc9c008e8b0 0x7fc9c0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:06.142 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.137+0000 7fc9baffd700 1 -- 172.21.15.55:0/2514447813 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fc9cc0b5770 con 0x7fc9d413d060 2023-09-30T02:01:06.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.137+0000 7fc9d2ffd700 1 --2- 172.21.15.55:0/2514447813 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc9c008e8b0 0x7fc9c0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:06.143 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.137+0000 7fc9d2ffd700 1 --2- 172.21.15.55:0/2514447813 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc9c008e8b0 0x7fc9c0090d60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009db0 tx=0x7fc9c80091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:06.145 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.145+0000 7fc9baffd700 1 -- 172.21.15.55:0/2514447813 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc9cc085fe0 con 0x7fc9d413d060 2023-09-30T02:01:06.342 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.341+0000 7fc9d3fff700 1 -- 172.21.15.55:0/2514447813 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fc9d40680b0 con 0x7fc9d413d060 2023-09-30T02:01:06.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.341+0000 7fc9baffd700 1 -- 172.21.15.55:0/2514447813 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fc9cc087f10 con 0x7fc9d413d060 2023-09-30T02:01:06.343 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:01:06.343 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:01:06.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.341+0000 7fc9d3fff700 10 mgrc shutdown 2023-09-30T02:01:06.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.345+0000 7fc9d3fff700 1 -- 172.21.15.55:0/2514447813 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc9c008e8b0 msgr2=0x7fc9c0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:06.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.345+0000 7fc9d3fff700 1 --2- 172.21.15.55:0/2514447813 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc9c008e8b0 0x7fc9c0090d60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc9c8009db0 tx=0x7fc9c80091a0 comp rx=0 tx=0).stop 2023-09-30T02:01:06.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.345+0000 7fc9d3fff700 1 -- 172.21.15.55:0/2514447813 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9d413d060 msgr2=0x7fc9d414fc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:06.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.345+0000 7fc9d3fff700 1 --2- 172.21.15.55:0/2514447813 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9d413d060 0x7fc9d414fc40 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fc9cc001460 tx=0x7fc9cc001a40 comp rx=0 tx=0).stop 2023-09-30T02:01:06.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.345+0000 7fc9d3fff700 1 -- 172.21.15.55:0/2514447813 shutdown_connections 2023-09-30T02:01:06.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.345+0000 7fc9d3fff700 1 --2- 172.21.15.55:0/2514447813 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc9c008e8b0 0x7fc9c0090d60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:06.346 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.345+0000 7fc9d3fff700 1 --2- 172.21.15.55:0/2514447813 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc9d413d060 0x7fc9d414fc40 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:06.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.345+0000 7fc9d3fff700 1 --2- 172.21.15.55:0/2514447813 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc9d40a4bc0 0x7fc9d413fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:06.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.345+0000 7fc9d3fff700 1 --2- 172.21.15.55:0/2514447813 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc9d406c360 0x7fc9d40a3fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:06.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.345+0000 7fc9d3fff700 1 -- 172.21.15.55:0/2514447813 >> 172.21.15.55:0/2514447813 conn(0x7fc9d40b23d0 msgr2=0x7fc9d413ac50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:01:06.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.345+0000 7fc9d3fff700 1 -- 172.21.15.55:0/2514447813 shutdown_connections 2023-09-30T02:01:06.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:06.345+0000 7fc9d3fff700 1 -- 172.21.15.55:0/2514447813 wait complete. 2023-09-30T02:01:09.361 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:01:09.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf271d7700 1 Processor -- start 2023-09-30T02:01:09.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf271d7700 1 -- start start 2023-09-30T02:01:09.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf271d7700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbf20143740 0x7fbf20143b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:09.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf271d7700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf20135ed0 0x7fbf20136300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:09.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf271d7700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf200b3430 con 0x7fbf200b3060 2023-09-30T02:01:09.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf271d7700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf201443d0 con 0x7fbf20143740 2023-09-30T02:01:09.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf271d7700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2006dae0 con 0x7fbf20135ed0 2023-09-30T02:01:09.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf25774700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf20135ed0 0x7fbf20136300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:09.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf1ffff700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fbf20143740 0x7fbf20143b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:09.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf25774700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf20135ed0 0x7fbf20136300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:46330/0 (socket says 172.21.15.55:46330) 2023-09-30T02:01:09.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf25774700 1 -- 172.21.15.55:0/1302666847 learned_addr learned my addr 172.21.15.55:0/1302666847 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:01:09.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf1ffff700 1 --2- 172.21.15.55:0/1302666847 >> v2:172.21.15.133:3300/0 conn(0x7fbf20143740 0x7fbf20143b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.133:3300/0 says I am v2:172.21.15.55:56778/0 (socket says 172.21.15.55:56778) 2023-09-30T02:01:09.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf1ffff700 1 -- 172.21.15.55:0/1302666847 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf20135ed0 msgr2=0x7fbf20136300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:01:09.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf1ffff700 1 --2- 172.21.15.55:0/1302666847 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf20135ed0 0x7fbf20136300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:09.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf1ffff700 1 -- 172.21.15.55:0/1302666847 >> v1:172.21.15.133:6789/0 conn(0x7fbf200b3060 legacy=0x7fbf2006d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:09.478 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.473+0000 7fbf1ffff700 1 -- 172.21.15.55:0/1302666847 --> v2:172.21.15.133:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf20144090 con 0x7fbf20143740 2023-09-30T02:01:09.479 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf1ffff700 1 --2- 172.21.15.55:0/1302666847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf20143740 0x7fbf20143b50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbf100098e0 tx=0x7fbf100091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=809151f886f62ac1 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf1f7fe700 1 -- 172.21.15.55:0/1302666847 <== mon.1 v2:172.21.15.133:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000b640 con 0x7fbf20143740 2023-09-30T02:01:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf1f7fe700 1 -- 172.21.15.55:0/1302666847 <== mon.1 v2:172.21.15.133:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1000b7a0 con 0x7fbf20143740 2023-09-30T02:01:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf1f7fe700 1 -- 172.21.15.55:0/1302666847 <== mon.1 v2:172.21.15.133:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1000bb40 con 0x7fbf20143740 2023-09-30T02:01:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 -- 172.21.15.55:0/1302666847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf20143740 msgr2=0x7fbf20143b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 --2- 172.21.15.55:0/1302666847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf20143740 0x7fbf20143b50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fbf100098e0 tx=0x7fbf100091a0 comp rx=0 tx=0).stop 2023-09-30T02:01:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 -- 172.21.15.55:0/1302666847 shutdown_connections 2023-09-30T02:01:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 --2- 172.21.15.55:0/1302666847 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf20135ed0 0x7fbf20136300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 --2- 172.21.15.55:0/1302666847 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf20143740 0x7fbf20143b50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 -- 172.21.15.55:0/1302666847 >> 172.21.15.55:0/1302666847 conn(0x7fbf20068b00 msgr2=0x7fbf200b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:01:09.481 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 -- 172.21.15.55:0/1302666847 shutdown_connections 2023-09-30T02:01:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 -- 172.21.15.55:0/1302666847 wait complete. 2023-09-30T02:01:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 Processor -- start 2023-09-30T02:01:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 -- start start 2023-09-30T02:01:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf200b3060 0x7fbf200af040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf20135ed0 0x7fbf20137a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf20143740 0x7fbf20153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf200ad7f0 con 0x7fbf20135ed0 2023-09-30T02:01:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf20137f90 con 0x7fbf200b3060 2023-09-30T02:01:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf271d7700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf200ad9e0 con 0x7fbf20143740 2023-09-30T02:01:09.482 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf25774700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf20143740 0x7fbf20153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf1ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf20135ed0 0x7fbf20137a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf25774700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf20143740 0x7fbf20153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:46346/0 (socket says 172.21.15.55:46346) 2023-09-30T02:01:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf1ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf20135ed0 0x7fbf20137a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:54210/0 (socket says 172.21.15.55:54210) 2023-09-30T02:01:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf25774700 1 -- 172.21.15.55:0/4047185770 learned_addr learned my addr 172.21.15.55:0/4047185770 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:01:09.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf24f73700 1 --2- 172.21.15.55:0/4047185770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf200b3060 0x7fbf200af040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:09.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf1ffff700 1 -- 172.21.15.55:0/4047185770 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf20143740 msgr2=0x7fbf20153560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:09.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf1ffff700 1 --2- 172.21.15.55:0/4047185770 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf20143740 0x7fbf20153560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:09.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf1ffff700 1 -- 172.21.15.55:0/4047185770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf200b3060 msgr2=0x7fbf200af040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:09.484 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.477+0000 7fbf1ffff700 1 --2- 172.21.15.55:0/4047185770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf200b3060 0x7fbf200af040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.481+0000 7fbf1ffff700 1 -- 172.21.15.55:0/4047185770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf10009420 con 0x7fbf20135ed0 2023-09-30T02:01:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.481+0000 7fbf1ffff700 1 --2- 172.21.15.55:0/4047185770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf20135ed0 0x7fbf20137a50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf20068fc0 tx=0x7fbf10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.481+0000 7fbf1cff9700 1 -- 172.21.15.55:0/4047185770 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf1001bb30 con 0x7fbf20135ed0 2023-09-30T02:01:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.481+0000 7fbf1cff9700 1 -- 172.21.15.55:0/4047185770 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf1001bc90 con 0x7fbf20135ed0 2023-09-30T02:01:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.481+0000 7fbf271d7700 1 -- 172.21.15.55:0/4047185770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf200acb20 con 0x7fbf20135ed0 2023-09-30T02:01:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.481+0000 7fbf1cff9700 1 -- 172.21.15.55:0/4047185770 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf10011670 con 0x7fbf20135ed0 2023-09-30T02:01:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.481+0000 7fbf271d7700 1 -- 172.21.15.55:0/4047185770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf20153cc0 con 0x7fbf20135ed0 2023-09-30T02:01:09.485 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.481+0000 7fbf271d7700 1 -- 172.21.15.55:0/4047185770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf20068300 con 0x7fbf20135ed0 2023-09-30T02:01:09.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.485+0000 7fbf1cff9700 1 -- 172.21.15.55:0/4047185770 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fbf10011a20 con 0x7fbf20135ed0 2023-09-30T02:01:09.486 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.485+0000 7fbf1cff9700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:01:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.485+0000 7fbf1cff9700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:01:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.485+0000 7fbf1cff9700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:01:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.485+0000 7fbf1cff9700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:01:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.485+0000 7fbf1cff9700 1 --2- 172.21.15.55:0/4047185770 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbf0c08e8b0 0x7fbf0c090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:09.487 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.485+0000 7fbf1cff9700 1 -- 172.21.15.55:0/4047185770 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fbf100b5bc0 con 0x7fbf20135ed0 2023-09-30T02:01:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.485+0000 7fbf24f73700 1 --2- 172.21.15.55:0/4047185770 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbf0c08e8b0 0x7fbf0c090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:09.488 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.485+0000 7fbf24f73700 1 --2- 172.21.15.55:0/4047185770 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbf0c08e8b0 0x7fbf0c090d60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbf14003a80 tx=0x7fbf14007ec0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:09.496 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.493+0000 7fbf1cff9700 1 -- 172.21.15.55:0/4047185770 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fbf10086550 con 0x7fbf20135ed0 2023-09-30T02:01:09.696 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.693+0000 7fbf271d7700 1 -- 172.21.15.55:0/4047185770 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fbf20136840 con 0x7fbf20135ed0 2023-09-30T02:01:09.697 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.693+0000 7fbf1cff9700 1 -- 172.21.15.55:0/4047185770 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fbf10089b70 con 0x7fbf20135ed0 2023-09-30T02:01:09.697 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:01:09.697 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:01:09.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.697+0000 7fbf271d7700 10 mgrc shutdown 2023-09-30T02:01:09.699 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.697+0000 7fbf271d7700 1 -- 172.21.15.55:0/4047185770 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbf0c08e8b0 msgr2=0x7fbf0c090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.697+0000 7fbf271d7700 1 --2- 172.21.15.55:0/4047185770 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbf0c08e8b0 0x7fbf0c090d60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fbf14003a80 tx=0x7fbf14007ec0 comp rx=0 tx=0).stop 2023-09-30T02:01:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.697+0000 7fbf271d7700 1 -- 172.21.15.55:0/4047185770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf20135ed0 msgr2=0x7fbf20137a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.697+0000 7fbf271d7700 1 --2- 172.21.15.55:0/4047185770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf20135ed0 0x7fbf20137a50 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fbf20068fc0 tx=0x7fbf10017000 comp rx=0 tx=0).stop 2023-09-30T02:01:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.697+0000 7fbf271d7700 1 -- 172.21.15.55:0/4047185770 shutdown_connections 2023-09-30T02:01:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.697+0000 7fbf271d7700 1 --2- 172.21.15.55:0/4047185770 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fbf0c08e8b0 0x7fbf0c090d60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.697+0000 7fbf271d7700 1 --2- 172.21.15.55:0/4047185770 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fbf20143740 0x7fbf20153560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.697+0000 7fbf271d7700 1 --2- 172.21.15.55:0/4047185770 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fbf20135ed0 0x7fbf20137a50 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.697+0000 7fbf271d7700 1 --2- 172.21.15.55:0/4047185770 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fbf200b3060 0x7fbf200af040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.697+0000 7fbf271d7700 1 -- 172.21.15.55:0/4047185770 >> 172.21.15.55:0/4047185770 conn(0x7fbf20068b00 msgr2=0x7fbf201320c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:01:09.700 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.697+0000 7fbf271d7700 1 -- 172.21.15.55:0/4047185770 shutdown_connections 2023-09-30T02:01:09.701 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:09.697+0000 7fbf271d7700 1 -- 172.21.15.55:0/4047185770 wait complete. 2023-09-30T02:01:12.716 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-09-30T02:01:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca51119700 1 Processor -- start 2023-09-30T02:01:12.828 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca51119700 1 -- start start 2023-09-30T02:01:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca51119700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca4c0b3060 0x7fca4c0a6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca51119700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4c0b3430 con 0x7fca4c0a7f20 2023-09-30T02:01:12.829 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca51119700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca4c0a4b60 con 0x7fca4c13e5f0 2023-09-30T02:01:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca51119700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c13b8f0 con 0x7fca4c0b3060 2023-09-30T02:01:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca4b59e700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7fca4c0a7f20 0x7fca4c1487c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55560/0 (socket says 172.21.15.55:55560) 2023-09-30T02:01:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca4b59e700 1 -- 172.21.15.55:0/2355408498 learned_addr learned my addr 172.21.15.55:0/2355408498 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T02:01:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca4ad9d700 1 --2- 172.21.15.55:0/2355408498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca4c0b3060 0x7fca4c0a6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca49d9b700 1 -- 172.21.15.55:0/2355408498 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1452331682 0 0) 0x7fca4c0b3430 con 0x7fca4c0a7f20 2023-09-30T02:01:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca49d9b700 1 -- 172.21.15.55:0/2355408498 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca34003570 con 0x7fca4c0a7f20 2023-09-30T02:01:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca49d9b700 1 -- 172.21.15.55:0/2355408498 <== mon.1 v1:172.21.15.133:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149093379 0 0) 0x7fca4c0a4b60 con 0x7fca4c13e5f0 2023-09-30T02:01:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca49d9b700 1 -- 172.21.15.55:0/2355408498 --> v1:172.21.15.133:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca4c0b3430 con 0x7fca4c13e5f0 2023-09-30T02:01:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca4ad9d700 1 -- 172.21.15.55:0/2355408498 >> v1:172.21.15.133:6789/0 conn(0x7fca4c13e5f0 legacy=0x7fca4c0a7810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca49d9b700 1 -- 172.21.15.55:0/2355408498 <== mon.0 v1:172.21.15.55:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3715954537 0 0) 0x7fca34003570 con 0x7fca4c0a7f20 2023-09-30T02:01:12.830 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca4ad9d700 1 -- 172.21.15.55:0/2355408498 >> v1:172.21.15.55:6789/0 conn(0x7fca4c0a7f20 legacy=0x7fca4c1487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:12.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.825+0000 7fca4ad9d700 1 -- 172.21.15.55:0/2355408498 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca4c13dfa0 con 0x7fca4c0b3060 2023-09-30T02:01:12.831 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.829+0000 7fca4ad9d700 1 --2- 172.21.15.55:0/2355408498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca4c0b3060 0x7fca4c0a6120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fca40009910 tx=0x7fca400091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2e56f23fe3197955 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.829+0000 7fca49d9b700 1 -- 172.21.15.55:0/2355408498 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca440017f0 con 0x7fca4c0b3060 2023-09-30T02:01:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.829+0000 7fca49d9b700 1 -- 172.21.15.55:0/2355408498 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca40011420 con 0x7fca4c0b3060 2023-09-30T02:01:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.829+0000 7fca49d9b700 1 -- 172.21.15.55:0/2355408498 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca400117c0 con 0x7fca4c0b3060 2023-09-30T02:01:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.829+0000 7fca51119700 1 -- 172.21.15.55:0/2355408498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca4c0b3060 msgr2=0x7fca4c0a6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.829+0000 7fca51119700 1 --2- 172.21.15.55:0/2355408498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca4c0b3060 0x7fca4c0a6120 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fca40009910 tx=0x7fca400091a0 comp rx=0 tx=0).stop 2023-09-30T02:01:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.829+0000 7fca51119700 1 -- 172.21.15.55:0/2355408498 shutdown_connections 2023-09-30T02:01:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.829+0000 7fca51119700 1 --2- 172.21.15.55:0/2355408498 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca4c0b3060 0x7fca4c0a6120 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.829+0000 7fca51119700 1 -- 172.21.15.55:0/2355408498 >> 172.21.15.55:0/2355408498 conn(0x7fca4c068b00 msgr2=0x7fca4c0b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:01:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.829+0000 7fca51119700 1 -- 172.21.15.55:0/2355408498 shutdown_connections 2023-09-30T02:01:12.832 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.829+0000 7fca51119700 1 -- 172.21.15.55:0/2355408498 wait complete. 2023-09-30T02:01:12.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca51119700 1 Processor -- start 2023-09-30T02:01:12.833 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca51119700 1 -- start start 2023-09-30T02:01:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca51119700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca4c0a7f20 0x7fca4c0a8d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca51119700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca4c0b3060 0x7fca4c1369a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca51119700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4c13e5f0 0x7fca4c136ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca51119700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c137420 con 0x7fca4c0b3060 2023-09-30T02:01:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca51119700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c13f220 con 0x7fca4c13e5f0 2023-09-30T02:01:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca51119700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca4c13f4e0 con 0x7fca4c0a7f20 2023-09-30T02:01:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca4a59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca4c0b3060 0x7fca4c1369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca4a59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca4c0b3060 0x7fca4c1369a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52418/0 (socket says 172.21.15.55:52418) 2023-09-30T02:01:12.836 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca4ad9d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca4c0a7f20 0x7fca4c0a8d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca4a59c700 1 -- 172.21.15.55:0/3694854568 learned_addr learned my addr 172.21.15.55:0/3694854568 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:01:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca4b59e700 1 --2- 172.21.15.55:0/3694854568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4c13e5f0 0x7fca4c136ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca4a59c700 1 -- 172.21.15.55:0/3694854568 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca4c0a7f20 msgr2=0x7fca4c0a8d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca4a59c700 1 --2- 172.21.15.55:0/3694854568 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca4c0a7f20 0x7fca4c0a8d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca4a59c700 1 -- 172.21.15.55:0/3694854568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4c13e5f0 msgr2=0x7fca4c136ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca4a59c700 1 --2- 172.21.15.55:0/3694854568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4c13e5f0 0x7fca4c136ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca4a59c700 1 -- 172.21.15.55:0/3694854568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca40009420 con 0x7fca4c0b3060 2023-09-30T02:01:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca4b59e700 1 --2- 172.21.15.55:0/3694854568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4c13e5f0 0x7fca4c136ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T02:01:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca4a59c700 1 --2- 172.21.15.55:0/3694854568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca4c0b3060 0x7fca4c1369a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00c580 tx=0x7fca3c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca32ffd700 1 -- 172.21.15.55:0/3694854568 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c010510 con 0x7fca4c0b3060 2023-09-30T02:01:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca32ffd700 1 -- 172.21.15.55:0/3694854568 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c010670 con 0x7fca4c0b3060 2023-09-30T02:01:12.837 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca51119700 1 -- 172.21.15.55:0/3694854568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca4c13f7a0 con 0x7fca4c0b3060 2023-09-30T02:01:12.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca32ffd700 1 -- 172.21.15.55:0/3694854568 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c010a30 con 0x7fca4c0b3060 2023-09-30T02:01:12.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.833+0000 7fca51119700 1 -- 172.21.15.55:0/3694854568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca4c0a9280 con 0x7fca4c0b3060 2023-09-30T02:01:12.838 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.837+0000 7fca51119700 1 -- 172.21.15.55:0/3694854568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca4c0a8ac0 con 0x7fca4c0b3060 2023-09-30T02:01:12.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.837+0000 7fca32ffd700 1 -- 172.21.15.55:0/3694854568 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fca3c025430 con 0x7fca4c0b3060 2023-09-30T02:01:12.839 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.837+0000 7fca32ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:01:12.840 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.837+0000 7fca32ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:01:12.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.837+0000 7fca32ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:01:12.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.837+0000 7fca32ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:01:12.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.837+0000 7fca32ffd700 1 --2- 172.21.15.55:0/3694854568 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fca3808e8b0 0x7fca38090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:12.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.837+0000 7fca4ad9d700 1 --2- 172.21.15.55:0/3694854568 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fca3808e8b0 0x7fca38090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:12.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.837+0000 7fca32ffd700 1 -- 172.21.15.55:0/3694854568 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fca3c0b4f10 con 0x7fca4c0b3060 2023-09-30T02:01:12.841 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.841+0000 7fca4ad9d700 1 --2- 172.21.15.55:0/3694854568 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fca3808e8b0 0x7fca38090d60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fca400030c0 tx=0x7fca40016000 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:12.845 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:12.841+0000 7fca32ffd700 1 -- 172.21.15.55:0/3694854568 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fca3c0858a0 con 0x7fca4c0b3060 2023-09-30T02:01:13.039 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.037+0000 7fca51119700 1 -- 172.21.15.55:0/3694854568 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fca4c13e240 con 0x7fca4c0b3060 2023-09-30T02:01:13.040 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.037+0000 7fca32ffd700 1 -- 172.21.15.55:0/3694854568 <== mon.0 v2:172.21.15.55:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+227 (secure 0 0 0) 0x7fca3c088ec0 con 0x7fca4c0b3060 2023-09-30T02:01:13.040 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:01:13.040 INFO:teuthology.orchestra.run.smithi055.stdout:{"status":"HEALTH_ERR","checks":{"MGR_MODULE_ERROR":{"severity":"HEALTH_ERR","summary":{"message":"Module 'pg_autoscaler' has failed: 'PgAutoscaler' object has no attribute 'noautoscale'","count":1},"muted":false}},"mutes":[]} 2023-09-30T02:01:13.041 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.041+0000 7fca51119700 10 mgrc shutdown 2023-09-30T02:01:13.042 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.041+0000 7fca51119700 1 -- 172.21.15.55:0/3694854568 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fca3808e8b0 msgr2=0x7fca38090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.041+0000 7fca51119700 1 --2- 172.21.15.55:0/3694854568 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fca3808e8b0 0x7fca38090d60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fca400030c0 tx=0x7fca40016000 comp rx=0 tx=0).stop 2023-09-30T02:01:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.041+0000 7fca51119700 1 -- 172.21.15.55:0/3694854568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca4c0b3060 msgr2=0x7fca4c1369a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.041+0000 7fca51119700 1 --2- 172.21.15.55:0/3694854568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca4c0b3060 0x7fca4c1369a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fca3c00c580 tx=0x7fca3c007e10 comp rx=0 tx=0).stop 2023-09-30T02:01:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.041+0000 7fca51119700 1 -- 172.21.15.55:0/3694854568 shutdown_connections 2023-09-30T02:01:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.041+0000 7fca51119700 1 --2- 172.21.15.55:0/3694854568 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fca4c13e5f0 0x7fca4c136ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.041+0000 7fca51119700 1 --2- 172.21.15.55:0/3694854568 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fca4c0b3060 0x7fca4c1369a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.041+0000 7fca51119700 1 --2- 172.21.15.55:0/3694854568 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fca3808e8b0 0x7fca38090d60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.041+0000 7fca51119700 1 --2- 172.21.15.55:0/3694854568 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fca4c0a7f20 0x7fca4c0a8d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.041+0000 7fca51119700 1 -- 172.21.15.55:0/3694854568 >> 172.21.15.55:0/3694854568 conn(0x7fca4c068b00 msgr2=0x7fca4c06cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:01:13.043 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.041+0000 7fca51119700 1 -- 172.21.15.55:0/3694854568 shutdown_connections 2023-09-30T02:01:13.044 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.041+0000 7fca51119700 1 -- 172.21.15.55:0/3694854568 wait complete. 2023-09-30T02:01:13.054 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-09-30T02:01:13.054 DEBUG:teuthology.orchestra.run.smithi055:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-09-30T02:01:13.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc4154c1700 1 Processor -- start 2023-09-30T02:01:13.159 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc4154c1700 1 -- start start 2023-09-30T02:01:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc4154c1700 1 --2- >> v2:172.21.15.55:3300/0 conn(0x7fc4100670a0 0x7fc410140150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc4154c1700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc410067470 0x7fc41013f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc4154c1700 1 --2- >> v2:172.21.15.133:3300/0 conn(0x7fc4100a7070 0x7fc41006dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc4154c1700 1 -- --> v2:172.21.15.55:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41013fca0 con 0x7fc4100670a0 2023-09-30T02:01:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc4154c1700 1 -- --> v2:172.21.15.133:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41006cdc0 con 0x7fc4100a7070 2023-09-30T02:01:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc4154c1700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41006d080 con 0x7fc410067470 2023-09-30T02:01:13.161 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc40f7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc410067470 0x7fc41013f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:13.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc40f7fe700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc410067470 0x7fc41013f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:45264/0 (socket says 172.21.15.55:45264) 2023-09-30T02:01:13.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc40f7fe700 1 -- 172.21.15.55:0/1122434255 learned_addr learned my addr 172.21.15.55:0/1122434255 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:01:13.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc40ffff700 1 --2- 172.21.15.55:0/1122434255 >> v2:172.21.15.55:3300/0 conn(0x7fc4100670a0 0x7fc410140150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:13.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc414cc0700 1 --2- 172.21.15.55:0/1122434255 >> v2:172.21.15.133:3300/0 conn(0x7fc4100a7070 0x7fc41006dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:13.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc40f7fe700 1 -- 172.21.15.55:0/1122434255 >> v2:172.21.15.133:3300/0 conn(0x7fc4100a7070 msgr2=0x7fc41006dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:01:13.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc40f7fe700 1 --2- 172.21.15.55:0/1122434255 >> v2:172.21.15.133:3300/0 conn(0x7fc4100a7070 0x7fc41006dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc40f7fe700 1 -- 172.21.15.55:0/1122434255 >> v2:172.21.15.55:3300/0 conn(0x7fc4100670a0 msgr2=0x7fc410140150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-09-30T02:01:13.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc40f7fe700 1 --2- 172.21.15.55:0/1122434255 >> v2:172.21.15.55:3300/0 conn(0x7fc4100670a0 0x7fc410140150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc40f7fe700 1 -- 172.21.15.55:0/1122434255 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41006d340 con 0x7fc410067470 2023-09-30T02:01:13.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc40ffff700 1 --2- 172.21.15.55:0/1122434255 >> v2:172.21.15.55:3300/0 conn(0x7fc4100670a0 0x7fc410140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T02:01:13.162 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc40f7fe700 1 --2- 172.21.15.55:0/1122434255 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc410067470 0x7fc41013f760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc41006d530 tx=0x7fc400009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d90ffd09ed1f356 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:13.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc40effd700 1 -- 172.21.15.55:0/1122434255 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc400009e70 con 0x7fc410067470 2023-09-30T02:01:13.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc40effd700 1 -- 172.21.15.55:0/1122434255 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40000b830 con 0x7fc410067470 2023-09-30T02:01:13.163 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.157+0000 7fc40effd700 1 -- 172.21.15.55:0/1122434255 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40000bbf0 con 0x7fc410067470 2023-09-30T02:01:13.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.161+0000 7fc4154c1700 1 -- 172.21.15.55:0/1122434255 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc410067470 msgr2=0x7fc41013f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:13.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.161+0000 7fc4154c1700 1 --2- 172.21.15.55:0/1122434255 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc410067470 0x7fc41013f760 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fc41006d530 tx=0x7fc400009250 comp rx=0 tx=0).stop 2023-09-30T02:01:13.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.161+0000 7fc4154c1700 1 -- 172.21.15.55:0/1122434255 shutdown_connections 2023-09-30T02:01:13.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.161+0000 7fc4154c1700 1 --2- 172.21.15.55:0/1122434255 >> v2:172.21.15.133:3300/0 conn(0x7fc4100a7070 0x7fc41006dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.164 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.161+0000 7fc4154c1700 1 --2- 172.21.15.55:0/1122434255 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc410067470 0x7fc41013f760 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.161+0000 7fc4154c1700 1 --2- 172.21.15.55:0/1122434255 >> v2:172.21.15.55:3300/0 conn(0x7fc4100670a0 0x7fc410140150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.161+0000 7fc4154c1700 1 -- 172.21.15.55:0/1122434255 >> 172.21.15.55:0/1122434255 conn(0x7fc41006a7b0 msgr2=0x7fc4100a53c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:01:13.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.161+0000 7fc4154c1700 1 -- 172.21.15.55:0/1122434255 shutdown_connections 2023-09-30T02:01:13.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.161+0000 7fc4154c1700 1 -- 172.21.15.55:0/1122434255 wait complete. 2023-09-30T02:01:13.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.161+0000 7fc4154c1700 1 Processor -- start 2023-09-30T02:01:13.165 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.161+0000 7fc4154c1700 1 -- start start 2023-09-30T02:01:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc4154c1700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100670a0 0x7fc4100b0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:13.168 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc4154c1700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc410067470 0x7fc4100b3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:13.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc4154c1700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4100a7070 0x7fc4100a2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:13.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc4154c1700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41012d610 con 0x7fc4100670a0 2023-09-30T02:01:13.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc4154c1700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41012d8b0 con 0x7fc410067470 2023-09-30T02:01:13.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc4154c1700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4100a2780 con 0x7fc4100a7070 2023-09-30T02:01:13.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc40ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100670a0 0x7fc4100b0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:13.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc414cc0700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4100a7070 0x7fc4100a2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:13.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc40ffff700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100670a0 0x7fc4100b0230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3300/0 says I am v2:172.21.15.55:52440/0 (socket says 172.21.15.55:52440) 2023-09-30T02:01:13.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc40ffff700 1 -- 172.21.15.55:0/1246310482 learned_addr learned my addr 172.21.15.55:0/1246310482 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:01:13.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc40f7fe700 1 --2- 172.21.15.55:0/1246310482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc410067470 0x7fc4100b3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:13.169 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc414cc0700 1 -- 172.21.15.55:0/1246310482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc410067470 msgr2=0x7fc4100b3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:13.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc414cc0700 1 --2- 172.21.15.55:0/1246310482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc410067470 0x7fc4100b3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc414cc0700 1 -- 172.21.15.55:0/1246310482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100670a0 msgr2=0x7fc4100b0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:13.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc414cc0700 1 --2- 172.21.15.55:0/1246310482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100670a0 0x7fc4100b0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc414cc0700 1 -- 172.21.15.55:0/1246310482 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404009420 con 0x7fc4100a7070 2023-09-30T02:01:13.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc414cc0700 1 --2- 172.21.15.55:0/1246310482 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4100a7070 0x7fc4100a2240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc408007ed0 tx=0x7fc408009850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:13.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc3f7fff700 1 -- 172.21.15.55:0/1246310482 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40800eb90 con 0x7fc4100a7070 2023-09-30T02:01:13.170 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc3f7fff700 1 -- 172.21.15.55:0/1246310482 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40800ecf0 con 0x7fc4100a7070 2023-09-30T02:01:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc4154c1700 1 -- 172.21.15.55:0/1246310482 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4000094f0 con 0x7fc4100a7070 2023-09-30T02:01:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc3f7fff700 1 -- 172.21.15.55:0/1246310482 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc408014670 con 0x7fc4100a7070 2023-09-30T02:01:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.165+0000 7fc4154c1700 1 -- 172.21.15.55:0/1246310482 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41012c7c0 con 0x7fc4100a7070 2023-09-30T02:01:13.171 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.169+0000 7fc4154c1700 1 -- 172.21.15.55:0/1246310482 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4100b3c20 con 0x7fc4100a7070 2023-09-30T02:01:13.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.169+0000 7fc3f7fff700 1 -- 172.21.15.55:0/1246310482 <== mon.2 v2:172.21.15.55:3301/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7fc408003020 con 0x7fc4100a7070 2023-09-30T02:01:13.173 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.169+0000 7fc3f7fff700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:01:13.174 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.173+0000 7fc3f7fff700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:01:13.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.173+0000 7fc3f7fff700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:01:13.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.173+0000 7fc3f7fff700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:01:13.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.173+0000 7fc3f7fff700 1 --2- 172.21.15.55:0/1246310482 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc3fc08e8b0 0x7fc3fc090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:13.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.173+0000 7fc3f7fff700 1 -- 172.21.15.55:0/1246310482 <== mon.2 v2:172.21.15.55:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7fc4080b5810 con 0x7fc4100a7070 2023-09-30T02:01:13.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.173+0000 7fc40ffff700 1 --2- 172.21.15.55:0/1246310482 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc3fc08e8b0 0x7fc3fc090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:13.175 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.173+0000 7fc40ffff700 1 --2- 172.21.15.55:0/1246310482 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc3fc08e8b0 0x7fc3fc090d60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc404009fa0 tx=0x7fc4040091a0 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:13.180 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.177+0000 7fc3f7fff700 1 -- 172.21.15.55:0/1246310482 <== mon.2 v2:172.21.15.55:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7fc4080861a0 con 0x7fc4100a7070 2023-09-30T02:01:13.343 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.341+0000 7fc4154c1700 1 -- 172.21.15.55:0/1246310482 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4100b3c20 con 0x7fc4100a7070 2023-09-30T02:01:13.344 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.341+0000 7fc3f7fff700 1 -- 172.21.15.55:0/1246310482 <== mon.2 v2:172.21.15.55:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+12429 (secure 0 0 0) 0x7fc4100b3c20 con 0x7fc4100a7070 2023-09-30T02:01:13.345 INFO:teuthology.orchestra.run.smithi055.stdout: 2023-09-30T02:01:13.345 INFO:teuthology.orchestra.run.smithi055.stdout:{"epoch":21,"fsid":"37496c89-c485-46e5-8550-5722d2abf46a","created":"2023-09-30T01:55:38.697831+0000","modified":"2023-09-30T01:56:44.659157+0000","last_up_change":"2023-09-30T01:55:48.191927+0000","last_in_change":"2023-09-30T01:55:39.813210+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-09-30T01:55:49.090600+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"12","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"rbd","create_time":"2023-09-30T01:55:54.370944+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2023-09-30T01:55:58.474504+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2023-09-30T01:55:59.107639+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9aa3e0a9-7a4b-4019-87ef-ee48a48ffe19","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6800","nonce":27634},{"type":"v1","addr":"172.21.15.55:6801","nonce":27634}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6802","nonce":27634},{"type":"v1","addr":"172.21.15.55:6803","nonce":27634}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6806","nonce":27634},{"type":"v1","addr":"172.21.15.55:6807","nonce":27634}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.55:6804","nonce":27634},{"type":"v1","addr":"172.21.15.55:6805","nonce":27634}]},"public_addr":"172.21.15.55:6801/27634","cluster_addr":"172.21.15.55:6803/27634","heartbeat_back_addr":"172.21.15.55:6807/27634","heartbeat_front_addr":"172.21.15.55:6805/27634","state":["exists","up"]},{"osd":1,"uuid":"b52b4f6f-00aa-4ef8-b3d4-467475cd0bac","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6808","nonce":30066},{"type":"v1","addr":"172.21.15.133:6809","nonce":30066}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6810","nonce":30066},{"type":"v1","addr":"172.21.15.133:6811","nonce":30066}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6814","nonce":30066},{"type":"v1","addr":"172.21.15.133:6815","nonce":30066}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6812","nonce":30066},{"type":"v1","addr":"172.21.15.133:6813","nonce":30066}]},"public_addr":"172.21.15.133:6809/30066","cluster_addr":"172.21.15.133:6811/30066","heartbeat_back_addr":"172.21.15.133:6815/30066","heartbeat_front_addr":"172.21.15.133:6813/30066","state":["exists","up"]},{"osd":2,"uuid":"c48b2c87-a33c-47fc-8b84-e64faad378b0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6816","nonce":30068},{"type":"v1","addr":"172.21.15.133:6817","nonce":30068}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6818","nonce":30068},{"type":"v1","addr":"172.21.15.133:6819","nonce":30068}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6822","nonce":30068},{"type":"v1","addr":"172.21.15.133:6823","nonce":30068}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6820","nonce":30068},{"type":"v1","addr":"172.21.15.133:6821","nonce":30068}]},"public_addr":"172.21.15.133:6817/30068","cluster_addr":"172.21.15.133:6819/30068","heartbeat_back_addr":"172.21.15.133:6823/30068","heartbeat_front_addr":"172.21.15.133:6821/30068","state":["exists","up"]},{"osd":3,"uuid":"614c2d45-f7b8-42e8-ba09-6e042a2358b1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6800","nonce":30067},{"type":"v1","addr":"172.21.15.133:6801","nonce":30067}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6802","nonce":30067},{"type":"v1","addr":"172.21.15.133:6803","nonce":30067}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6806","nonce":30067},{"type":"v1","addr":"172.21.15.133:6807","nonce":30067}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.133:6804","nonce":30067},{"type":"v1","addr":"172.21.15.133:6805","nonce":30067}]},"public_addr":"172.21.15.133:6801/30067","cluster_addr":"172.21.15.133:6803/30067","heartbeat_back_addr":"172.21.15.133:6807/30067","heartbeat_front_addr":"172.21.15.133:6805/30067","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.342817+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.400384+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.363652+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-09-30T01:55:45.069618+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.3","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.15","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":2}]},{"pgid":"4.3c","mappings":[{"from":1,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-09-30T02:01:13.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.345+0000 7fc4154c1700 10 mgrc shutdown 2023-09-30T02:01:13.347 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.345+0000 7fc4154c1700 1 -- 172.21.15.55:0/1246310482 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc3fc08e8b0 msgr2=0x7fc3fc090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.345+0000 7fc4154c1700 1 --2- 172.21.15.55:0/1246310482 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc3fc08e8b0 0x7fc3fc090d60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc404009fa0 tx=0x7fc4040091a0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.345+0000 7fc4154c1700 1 -- 172.21.15.55:0/1246310482 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4100a7070 msgr2=0x7fc4100a2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.345+0000 7fc4154c1700 1 --2- 172.21.15.55:0/1246310482 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4100a7070 0x7fc4100a2240 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fc408007ed0 tx=0x7fc408009850 comp rx=0 tx=0).stop 2023-09-30T02:01:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.345+0000 7fc4154c1700 1 -- 172.21.15.55:0/1246310482 shutdown_connections 2023-09-30T02:01:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.345+0000 7fc4154c1700 1 --2- 172.21.15.55:0/1246310482 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7fc3fc08e8b0 0x7fc3fc090d60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.345+0000 7fc4154c1700 1 --2- 172.21.15.55:0/1246310482 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7fc4100a7070 0x7fc4100a2240 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.345+0000 7fc4154c1700 1 --2- 172.21.15.55:0/1246310482 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7fc410067470 0x7fc4100b3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.345+0000 7fc4154c1700 1 --2- 172.21.15.55:0/1246310482 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7fc4100670a0 0x7fc4100b0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.345+0000 7fc4154c1700 1 -- 172.21.15.55:0/1246310482 >> 172.21.15.55:0/1246310482 conn(0x7fc41006a7b0 msgr2=0x7fc41006edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:01:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.345+0000 7fc4154c1700 1 -- 172.21.15.55:0/1246310482 shutdown_connections 2023-09-30T02:01:13.348 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.345+0000 7fc4154c1700 1 -- 172.21.15.55:0/1246310482 wait complete. 2023-09-30T02:01:13.360 DEBUG:teuthology.orchestra.run.smithi055:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-09-30T02:01:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.461+0000 7f9fd4a2d700 1 Processor -- start 2023-09-30T02:01:13.464 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.461+0000 7f9fd4a2d700 1 -- start start 2023-09-30T02:01:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.461+0000 7f9fd4a2d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fd0067680 0x7f9fd01485a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.461+0000 7f9fd4a2d700 1 -- --> v1:172.21.15.55:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd00a2280 con 0x7f9fd0133310 2023-09-30T02:01:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.461+0000 7f9fd4a2d700 1 -- --> v1:172.21.15.133:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9fd0140aa0 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.461+0000 7f9fd4a2d700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd0140d60 con 0x7f9fd0067680 2023-09-30T02:01:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.461+0000 7f9fce59c700 1 --1- >> v1:172.21.15.55:6789/0 conn(0x7f9fd0133310 0x7f9fd00a0800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.55:6789/0 says I am v1:172.21.15.55:55566/0 (socket says 172.21.15.55:55566) 2023-09-30T02:01:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.461+0000 7f9fce59c700 1 -- 172.21.15.55:0/2679340244 learned_addr learned my addr 172.21.15.55:0/2679340244 (peer_addr_for_me v1:172.21.15.55:0/0) 2023-09-30T02:01:13.465 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.461+0000 7f9fcf59e700 1 --2- 172.21.15.55:0/2679340244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fd0067680 0x7f9fd01485a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:13.466 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fcdd9b700 1 -- 172.21.15.55:0/2679340244 <== mon.0 v1:172.21.15.55:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535900594 0 0) 0x7f9fd00a2280 con 0x7f9fd0133310 2023-09-30T02:01:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fcdd9b700 1 -- 172.21.15.55:0/2679340244 --> v1:172.21.15.55:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9fbc003570 con 0x7f9fd0133310 2023-09-30T02:01:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fcf59e700 1 -- 172.21.15.55:0/2679340244 >> v1:172.21.15.133:6789/0 conn(0x7f9fd00a1eb0 legacy=0x7f9fd0140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fcf59e700 1 -- 172.21.15.55:0/2679340244 >> v1:172.21.15.55:6789/0 conn(0x7f9fd0133310 legacy=0x7f9fd00a0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fcf59e700 1 -- 172.21.15.55:0/2679340244 --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fd00a0f10 con 0x7f9fd0067680 2023-09-30T02:01:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fcf59e700 1 --2- 172.21.15.55:0/2679340244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fd0067680 0x7f9fd01485a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009910 tx=0x7f9fc80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7dc6959ff9f9e982 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fcdd9b700 1 -- 172.21.15.55:0/2679340244 <== mon.2 v2:172.21.15.55:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc800b680 con 0x7f9fd0067680 2023-09-30T02:01:13.467 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fcdd9b700 1 -- 172.21.15.55:0/2679340244 <== mon.2 v2:172.21.15.55:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc800b7e0 con 0x7f9fd0067680 2023-09-30T02:01:13.468 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fcdd9b700 1 -- 172.21.15.55:0/2679340244 <== mon.2 v2:172.21.15.55:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc800bba0 con 0x7f9fd0067680 2023-09-30T02:01:13.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/2679340244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fd0067680 msgr2=0x7f9fd01485a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:13.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fd4a2d700 1 --2- 172.21.15.55:0/2679340244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fd0067680 0x7f9fd01485a0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009910 tx=0x7f9fc80091a0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/2679340244 shutdown_connections 2023-09-30T02:01:13.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fd4a2d700 1 --2- 172.21.15.55:0/2679340244 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fd0067680 0x7f9fd01485a0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/2679340244 >> 172.21.15.55:0/2679340244 conn(0x7f9fd0070010 msgr2=0x7f9fd0068870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:01:13.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/2679340244 shutdown_connections 2023-09-30T02:01:13.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/2679340244 wait complete. 2023-09-30T02:01:13.469 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fd4a2d700 1 Processor -- start 2023-09-30T02:01:13.470 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.465+0000 7f9fd4a2d700 1 -- start start 2023-09-30T02:01:13.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fd4a2d700 1 --2- >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fd0067680 0x7f9fd01351c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:13.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fd4a2d700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fd00a1eb0 0x7f9fd01378b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:13.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fd4a2d700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fd0133310 0x7f9fd006d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:13.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fd4a2d700 1 -- --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd0137440 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fd4a2d700 1 -- --> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd006ddc0 con 0x7f9fd0067680 2023-09-30T02:01:13.472 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fd4a2d700 1 -- --> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9fd0149ce0 con 0x7f9fd0133310 2023-09-30T02:01:13.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fcf59e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fd0133310 0x7f9fd006d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:13.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fce59c700 1 --2- >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fd00a1eb0 0x7f9fd01378b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:13.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fcf59e700 1 --2- >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fd0133310 0x7f9fd006d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.55:3301/0 says I am v2:172.21.15.55:45294/0 (socket says 172.21.15.55:45294) 2023-09-30T02:01:13.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fcf59e700 1 -- 172.21.15.55:0/3874290307 learned_addr learned my addr 172.21.15.55:0/3874290307 (peer_addr_for_me v2:172.21.15.55:0/0) 2023-09-30T02:01:13.473 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fced9d700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fd0067680 0x7f9fd01351c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:13.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fce59c700 1 -- 172.21.15.55:0/3874290307 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fd0133310 msgr2=0x7f9fd006d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:13.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fce59c700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fd0133310 0x7f9fd006d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fce59c700 1 -- 172.21.15.55:0/3874290307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fd0067680 msgr2=0x7f9fd01351c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:13.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fce59c700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fd0067680 0x7f9fd01351c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fce59c700 1 -- 172.21.15.55:0/3874290307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9fc8009420 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fcf59e700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fd0133310 0x7f9fd006d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-09-30T02:01:13.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fced9d700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fd0067680 0x7f9fd01351c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-09-30T02:01:13.474 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fce59c700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fd00a1eb0 0x7f9fd01378b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000cb90 tx=0x7f9fc00019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:13.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fc6ffd700 1 -- 172.21.15.55:0/3874290307 <== mon.0 v2:172.21.15.55:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc000a8b0 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fc6ffd700 1 -- 172.21.15.55:0/3874290307 <== mon.0 v2:172.21.15.55:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9fc000aa30 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fc6ffd700 1 -- 172.21.15.55:0/3874290307 <== mon.0 v2:172.21.15.55:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9fc000adf0 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/3874290307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9fd0149fa0 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.475 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/3874290307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9fd0135a10 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.469+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/3874290307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9fd01375b0 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.473+0000 7f9fc6ffd700 1 -- 172.21.15.55:0/3874290307 <== mon.0 v2:172.21.15.55:3300/0 4 ==== mgrmap(e 5) v1 ==== 119739+0+0 (secure 0 0 0) 0x7f9fc0007300 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.473+0000 7f9fc6ffd700 20 mgrc handle_mgr_map mgrmap(e 5) v1 2023-09-30T02:01:13.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.473+0000 7f9fc6ffd700 4 mgrc handle_mgr_map Got map version 5 2023-09-30T02:01:13.476 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.473+0000 7f9fc6ffd700 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:01:13.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.473+0000 7f9fc6ffd700 4 mgrc reconnect Starting new session with [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] 2023-09-30T02:01:13.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.473+0000 7f9fc6ffd700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9fb008e8b0 0x7f9fb0090d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-09-30T02:01:13.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.473+0000 7f9fc6ffd700 1 -- 172.21.15.55:0/3874290307 <== mon.0 v2:172.21.15.55:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 4475+0+0 (secure 0 0 0) 0x7f9fc00b4c60 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.473+0000 7f9fced9d700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9fb008e8b0 0x7f9fb0090d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-09-30T02:01:13.477 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.473+0000 7f9fced9d700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9fb008e8b0 0x7f9fb0090d60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8007fd0 tx=0x7f9fb8009040 comp rx=0 tx=0).ready entity=mgr.4103 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-09-30T02:01:13.483 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.481+0000 7f9fc6ffd700 1 -- 172.21.15.55:0/3874290307 <== mon.0 v2:172.21.15.55:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+166856 (secure 0 0 0) 0x7f9fc0085560 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.645 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.641+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/3874290307 --> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f9fd0064440 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.652 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.649+0000 7f9fc6ffd700 1 -- 172.21.15.55:0/3874290307 <== mon.0 v2:172.21.15.55:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f9fc0085560 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.653 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.649+0000 7f9fc6ffd700 1 -- 172.21.15.55:0/3874290307 <== mon.0 v2:172.21.15.55:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f9fc0088b80 con 0x7f9fd00a1eb0 2023-09-30T02:01:13.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.657+0000 7f9fd4a2d700 10 mgrc shutdown 2023-09-30T02:01:13.658 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.657+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/3874290307 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9fb008e8b0 msgr2=0x7f9fb0090d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:13.659 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.657+0000 7f9fd4a2d700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9fb008e8b0 0x7f9fb0090d60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f9fb8007fd0 tx=0x7f9fb8009040 comp rx=0 tx=0).stop 2023-09-30T02:01:13.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.657+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/3874290307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fd00a1eb0 msgr2=0x7f9fd01378b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-09-30T02:01:13.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.657+0000 7f9fd4a2d700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fd00a1eb0 0x7f9fd01378b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9fc000cb90 tx=0x7f9fc00019c0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.657+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/3874290307 shutdown_connections 2023-09-30T02:01:13.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.657+0000 7f9fd4a2d700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.55:6808/27538,v1:172.21.15.55:6809/27538] conn(0x7f9fb008e8b0 0x7f9fb0090d60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.657+0000 7f9fd4a2d700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.55:3301/0,v1:172.21.15.55:6790/0] conn(0x7f9fd0133310 0x7f9fd006d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.657+0000 7f9fd4a2d700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.55:3300/0,v1:172.21.15.55:6789/0] conn(0x7f9fd00a1eb0 0x7f9fd01378b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.657+0000 7f9fd4a2d700 1 --2- 172.21.15.55:0/3874290307 >> [v2:172.21.15.133:3300/0,v1:172.21.15.133:6789/0] conn(0x7f9fd0067680 0x7f9fd01351c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-09-30T02:01:13.660 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.657+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/3874290307 >> 172.21.15.55:0/3874290307 conn(0x7f9fd0070010 msgr2=0x7f9fd00a0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-09-30T02:01:13.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.657+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/3874290307 shutdown_connections 2023-09-30T02:01:13.661 INFO:teuthology.orchestra.run.smithi055.stderr:2023-09-30T02:01:13.657+0000 7f9fd4a2d700 1 -- 172.21.15.55:0/3874290307 wait complete. 2023-09-30T02:01:13.672 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1895, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1472, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph_manager.py", line 3189, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2023-09-30T02:01:13.674 INFO:teuthology.misc:Shutting down mds daemons... 2023-09-30T02:01:13.674 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-09-30T02:01:13.674 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T02:01:13.688 INFO:tasks.ceph.mds.a:Stopped 2023-09-30T02:01:13.689 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-09-30T02:01:13.689 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T02:01:13.698 INFO:tasks.ceph.mds.c:Stopped 2023-09-30T02:01:13.698 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-09-30T02:01:13.698 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T02:01:13.714 INFO:tasks.ceph.mds.b:Stopped 2023-09-30T02:01:13.715 INFO:teuthology.misc:Shutting down osd daemons... 2023-09-30T02:01:13.715 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-09-30T02:01:13.715 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T02:01:13.802 INFO:tasks.ceph.osd.0:Stopped 2023-09-30T02:01:13.803 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-09-30T02:01:13.803 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T02:01:13.873 INFO:tasks.ceph.osd.1:Stopped 2023-09-30T02:01:13.873 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-09-30T02:01:13.874 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T02:01:13.968 INFO:tasks.ceph.osd.2:Stopped 2023-09-30T02:01:13.968 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-09-30T02:01:13.968 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T02:01:14.049 INFO:tasks.ceph.osd.3:Stopped 2023-09-30T02:01:14.050 INFO:teuthology.misc:Shutting down mgr daemons... 2023-09-30T02:01:14.050 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-09-30T02:01:14.050 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T02:01:14.076 INFO:tasks.ceph.mgr.x:Stopped 2023-09-30T02:01:14.076 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-09-30T02:01:14.077 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T02:01:14.106 INFO:tasks.ceph.mgr.y:Stopped 2023-09-30T02:01:14.106 DEBUG:tasks.ceph.mgr.z:waiting for process to exit 2023-09-30T02:01:14.106 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T02:01:14.176 INFO:tasks.ceph.mgr.z:Stopped 2023-09-30T02:01:14.176 INFO:teuthology.misc:Shutting down mon daemons... 2023-09-30T02:01:14.177 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-09-30T02:01:14.177 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T02:01:14.195 INFO:tasks.ceph.mon.a:Stopped 2023-09-30T02:01:14.195 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-09-30T02:01:14.195 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T02:01:14.215 INFO:tasks.ceph.mon.c:Stopped 2023-09-30T02:01:14.215 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-09-30T02:01:14.216 INFO:teuthology.orchestra.run:waiting for 300 2023-09-30T02:01:14.234 INFO:tasks.ceph.mon.b:Stopped 2023-09-30T02:01:14.234 INFO:tasks.ceph:Checking cluster log for badness... 2023-09-30T02:01:14.235 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(RECENT_CRASH\)' | egrep -v 'replacing it with standby' | egrep -v 'No standby daemons available' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-09-30T02:01:14.254 INFO:teuthology.orchestra.run.smithi055.stdout:1696038943.0467103 mgr.x (mgr.4103) 1 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: 'PgAutoscaler' object has no attribute 'noautoscale' 2023-09-30T02:01:14.255 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-09-30T02:01:14.256 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(RECENT_CRASH\)' | egrep -v 'replacing it with standby' | egrep -v 'No standby daemons available' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-09-30T02:01:14.315 DEBUG:teuthology.orchestra.run.smithi055:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(RECENT_CRASH\)' | egrep -v 'replacing it with standby' | egrep -v 'No standby daemons available' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2023-09-30T02:01:14.333 INFO:teuthology.orchestra.run.smithi055.stdout:1696038943.0467103 mgr.x (mgr.4103) 1 : cluster [ERR] Unhandled exception from module 'pg_autoscaler' while running on mgr.x: 'PgAutoscaler' object has no attribute 'noautoscale' 2023-09-30T02:01:14.334 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi055.front.sepia.ceph.com 2023-09-30T02:01:14.334 DEBUG:teuthology.orchestra.run.smithi055:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-09-30T02:01:14.375 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T02:01:14.383 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T02:01:14.796 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi133.front.sepia.ceph.com 2023-09-30T02:01:14.797 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-09-30T02:01:15.014 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi133.front.sepia.ceph.com 2023-09-30T02:01:15.014 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-09-30T02:01:15.263 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi133.front.sepia.ceph.com 2023-09-30T02:01:15.263 DEBUG:teuthology.orchestra.run.smithi133:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-09-30T02:01:15.446 INFO:tasks.ceph:Archiving mon data... 2023-09-30T02:01:15.448 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126/data/mon.a.tgz 2023-09-30T02:01:15.448 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2023-09-30T02:01:15.455 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.0gLAfWV2eR 2023-09-30T02:01:15.456 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0gLAfWV2eR 2023-09-30T02:01:15.581 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.0gLAfWV2eR 2023-09-30T02:01:15.600 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.0gLAfWV2eR is 307KB 2023-09-30T02:01:15.660 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.0gLAfWV2eR 2023-09-30T02:01:15.667 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126/data/mon.c.tgz 2023-09-30T02:01:15.667 DEBUG:teuthology.orchestra.run.smithi055:> mktemp 2023-09-30T02:01:15.674 INFO:teuthology.orchestra.run.smithi055.stdout:/tmp/tmp.RJiUoCay0u 2023-09-30T02:01:15.675 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.RJiUoCay0u 2023-09-30T02:01:15.782 DEBUG:teuthology.orchestra.run.smithi055:> sudo chmod 0666 /tmp/tmp.RJiUoCay0u 2023-09-30T02:01:15.844 DEBUG:teuthology.orchestra.remote:smithi055:/tmp/tmp.RJiUoCay0u is 426KB 2023-09-30T02:01:15.865 DEBUG:teuthology.orchestra.run.smithi055:> rm -fr /tmp/tmp.RJiUoCay0u 2023-09-30T02:01:15.872 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126/data/mon.b.tgz 2023-09-30T02:01:15.872 DEBUG:teuthology.orchestra.run.smithi133:> mktemp 2023-09-30T02:01:15.879 INFO:teuthology.orchestra.run.smithi133.stdout:/tmp/tmp.VHjaOGcIRS 2023-09-30T02:01:15.879 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.VHjaOGcIRS 2023-09-30T02:01:15.983 DEBUG:teuthology.orchestra.run.smithi133:> sudo chmod 0666 /tmp/tmp.VHjaOGcIRS 2023-09-30T02:01:16.003 DEBUG:teuthology.orchestra.remote:smithi133:/tmp/tmp.VHjaOGcIRS is 427KB 2023-09-30T02:01:16.065 DEBUG:teuthology.orchestra.run.smithi133:> rm -fr /tmp/tmp.VHjaOGcIRS 2023-09-30T02:01:16.072 INFO:tasks.ceph:Cleaning ceph cluster... 2023-09-30T02:01:16.072 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T02:01:16.074 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-09-30T02:01:16.090 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-09-30T02:01:16.090 DEBUG:teuthology.orchestra.run.smithi055:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T02:01:16.092 DEBUG:teuthology.orchestra.run.smithi133:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-09-30T02:01:16.117 INFO:teuthology.orchestra.run.smithi055.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T02:01:16.152 INFO:teuthology.orchestra.run.smithi133.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-09-30T02:01:16.158 INFO:tasks.ceph:Archiving crash dumps... 2023-09-30T02:01:16.160 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126/remote/smithi055/crash 2023-09-30T02:01:16.160 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T02:01:16.182 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126/remote/smithi133/crash 2023-09-30T02:01:16.183 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-09-30T02:01:16.200 INFO:tasks.ceph:Shutting down logrotate 2023-09-30T02:01:16.201 DEBUG:teuthology.orchestra.run.smithi055:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T02:01:16.227 DEBUG:teuthology.orchestra.run.smithi133:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-09-30T02:01:16.274 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-30T02:01:16.289 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-09-30T02:01:16.306 INFO:tasks.ceph:Compressing logs... 2023-09-30T02:01:16.306 DEBUG:teuthology.orchestra.run.smithi055:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T02:01:16.335 DEBUG:teuthology.orchestra.run.smithi133:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T02:01:18.762 INFO:tasks.ceph:Archiving logs... 2023-09-30T02:01:18.762 DEBUG:teuthology.misc:Transferring archived files from smithi055:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126/remote/smithi055/log 2023-09-30T02:01:18.764 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T02:01:19.041 DEBUG:teuthology.misc:Transferring archived files from smithi133:/var/log/ceph to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126/remote/smithi133/log 2023-09-30T02:01:19.042 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /var/log/ceph -- . 2023-09-30T02:01:19.339 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1895, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1472, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph_manager.py", line 3189, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2023-09-30T02:01:19.408 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=f1bfbcaadf3c4489b9677d5dc23c04f3 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1895, in task healthy(ctx=ctx, config=dict(cluster=config['cluster'])) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph.py", line 1472, in healthy manager.wait_until_healthy(timeout=300) File "/home/teuthworker/src/github.com_ceph_ceph-c_93dce5e17918f8aca65993a7a2dc40233a47b481/qa/tasks/ceph_manager.py", line 3189, in wait_until_healthy assert time.time() - start < timeout, \ AssertionError: timeout expired in wait_until_healthy 2023-09-30T02:01:19.411 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-09-30T02:01:19.424 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-09-30T02:01:19.492 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-09-30T02:01:19.492 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T02:01:19.504 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-09-30T02:01:19.569 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-09-30T02:01:19.580 INFO:teuthology.task.clock:Checking final clock skew... 2023-09-30T02:01:19.580 DEBUG:teuthology.orchestra.run.smithi055:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T02:01:19.582 DEBUG:teuthology.orchestra.run.smithi133:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-09-30T02:01:19.602 INFO:teuthology.orchestra.run.smithi055.stdout: remote refid st t when poll reach delay offset jitter 2023-09-30T02:01:19.603 INFO:teuthology.orchestra.run.smithi055.stdout:============================================================================== 2023-09-30T02:01:19.603 INFO:teuthology.orchestra.run.smithi055.stdout:*hv01.front.sepi 44.4.53.2 2 u 35 64 377 0.068 0.183 0.354 2023-09-30T02:01:19.603 INFO:teuthology.orchestra.run.smithi055.stdout:+hv02.front.sepi 63.231.80.2 3 u 23 64 377 0.091 0.529 0.277 2023-09-30T02:01:19.603 INFO:teuthology.orchestra.run.smithi055.stdout:+hv03.front.sepi 74.6.168.72 3 u 24 64 377 0.112 -0.102 0.239 2023-09-30T02:01:19.603 INFO:teuthology.orchestra.run.smithi055.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-30T02:01:19.606 INFO:teuthology.orchestra.run.smithi133.stdout: remote refid st t when poll reach delay offset jitter 2023-09-30T02:01:19.606 INFO:teuthology.orchestra.run.smithi133.stdout:============================================================================== 2023-09-30T02:01:19.606 INFO:teuthology.orchestra.run.smithi133.stdout:*hv01.front.sepi 44.4.53.2 2 u 23 64 377 0.085 0.832 0.556 2023-09-30T02:01:19.606 INFO:teuthology.orchestra.run.smithi133.stdout:+hv02.front.sepi 63.231.80.2 3 u 29 64 377 0.072 0.187 0.829 2023-09-30T02:01:19.606 INFO:teuthology.orchestra.run.smithi133.stdout:+hv03.front.sepi 74.6.168.72 3 u 28 64 377 0.099 -0.141 0.607 2023-09-30T02:01:19.607 INFO:teuthology.orchestra.run.smithi133.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2023-09-30T02:01:19.608 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-09-30T02:01:19.619 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-09-30T02:01:19.619 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-09-30T02:01:19.669 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-09-30T02:01:19.718 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-09-30T02:01:19.765 INFO:teuthology.task.internal:Duration was 843.363974 seconds 2023-09-30T02:01:19.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-09-30T02:01:19.818 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-09-30T02:01:19.818 DEBUG:teuthology.orchestra.run.smithi055:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T02:01:19.820 DEBUG:teuthology.orchestra.run.smithi133:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-09-30T02:01:19.874 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-09-30T02:01:19.875 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi055.front.sepia.ceph.com 2023-09-30T02:01:19.875 DEBUG:teuthology.orchestra.run.smithi055:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T02:01:19.889 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi133.front.sepia.ceph.com 2023-09-30T02:01:19.890 DEBUG:teuthology.orchestra.run.smithi133:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-09-30T02:01:19.905 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-09-30T02:01:19.906 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T02:01:19.935 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-09-30T02:01:19.969 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-09-30T02:01:19.970 DEBUG:teuthology.orchestra.run.smithi055:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T02:01:19.972 DEBUG:teuthology.orchestra.run.smithi133:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-09-30T02:01:20.034 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-09-30T02:01:20.044 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-09-30T02:01:20.044 DEBUG:teuthology.orchestra.run.smithi055:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T02:01:20.061 DEBUG:teuthology.orchestra.run.smithi133:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-09-30T02:01:20.078 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-09-30T02:01:20.091 DEBUG:teuthology.orchestra.run.smithi055:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T02:01:20.107 DEBUG:teuthology.orchestra.run.smithi133:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-09-30T02:01:20.120 INFO:teuthology.orchestra.run.smithi055.stdout:kernel.core_pattern = core 2023-09-30T02:01:20.121 INFO:teuthology.orchestra.run.smithi133.stdout:kernel.core_pattern = core 2023-09-30T02:01:20.148 DEBUG:teuthology.orchestra.run.smithi055:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T02:01:20.153 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T02:01:20.154 DEBUG:teuthology.orchestra.run.smithi133:> test -e /home/ubuntu/cephtest/archive/coredump 2023-09-30T02:01:20.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-09-30T02:01:20.196 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-09-30T02:01:20.205 INFO:teuthology.task.internal:Transferring archived files... 2023-09-30T02:01:20.206 DEBUG:teuthology.misc:Transferring archived files from smithi055:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126/remote/smithi055 2023-09-30T02:01:20.206 DEBUG:teuthology.orchestra.run.smithi055:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-30T02:01:20.229 DEBUG:teuthology.misc:Transferring archived files from smithi133:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126/remote/smithi133 2023-09-30T02:01:20.229 DEBUG:teuthology.orchestra.run.smithi133:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-09-30T02:01:20.252 INFO:teuthology.task.internal:Removing archive directory... 2023-09-30T02:01:20.252 DEBUG:teuthology.orchestra.run.smithi055:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-30T02:01:20.267 DEBUG:teuthology.orchestra.run.smithi133:> rm -rf -- /home/ubuntu/cephtest/archive 2023-09-30T02:01:20.297 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-09-30T02:01:20.307 INFO:teuthology.task.internal:Not uploading archives. 2023-09-30T02:01:20.308 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-09-30T02:01:20.344 INFO:teuthology.task.internal:Tidying up after the test... 2023-09-30T02:01:20.345 DEBUG:teuthology.orchestra.run.smithi055:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T02:01:20.347 DEBUG:teuthology.orchestra.run.smithi133:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-09-30T02:01:20.352 INFO:teuthology.orchestra.run.smithi055.stdout: 924113 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 02:01 /home/ubuntu/cephtest 2023-09-30T02:01:20.355 INFO:teuthology.orchestra.run.smithi133.stdout: 924112 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 30 02:01 /home/ubuntu/cephtest 2023-09-30T02:01:20.357 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-09-30T02:01:20.394 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-09-30T02:01:20.494 INFO:teuthology.nuke:Checking targets against current locks 2023-09-30T02:01:20.519 DEBUG:teuthology.nuke:shortname: smithi055 2023-09-30T02:01:20.520 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T02:01:20.547 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi055.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 01:37:56.412657', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-09-30T02:01:20.548 DEBUG:teuthology.nuke:shortname: smithi133 2023-09-30T02:01:20.549 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-09-30T02:01:20.575 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi133.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2023-09-29_19:38:56-rados-wip-yuri4-testing-2023-09-29-0928-quincy-distro-default-smithi/7407126', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '20.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-09-30 01:37:56.414522', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFyT/r7xuKfmg50w0OdQebr4A/ptJo1Zk6DyZNZNZM/q5rW+sznh+wvHqeT3e4YtCdZLaXyvMms8o8u8H5nXOYM='} 2023-09-30T02:01:20.601 INFO:teuthology.orchestra.console.smithi055:Power off 2023-09-30T02:01:20.601 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T02:01:20.625 DEBUG:teuthology.orchestra.console.smithi055:power off output: Chassis Power Control: Down/Off 2023-09-30T02:01:20.625 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T02:01:20.643 INFO:teuthology.orchestra.console.smithi133:Power off 2023-09-30T02:01:20.643 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-09-30T02:01:20.655 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2023-09-30T02:01:20.667 DEBUG:teuthology.orchestra.console.smithi133:power off output: Chassis Power Control: Down/Off 2023-09-30T02:01:20.667 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T02:01:20.693 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-09-30T02:01:24.656 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T02:01:24.694 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T02:01:24.770 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2023-09-30T02:01:24.806 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is on 2023-09-30T02:01:28.772 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T02:01:28.807 DEBUG:teuthology.orchestra.console.smithi133:pexpect command: ipmitool -H smithi133.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T02:01:28.882 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is on 2023-09-30T02:01:28.916 DEBUG:teuthology.orchestra.console.smithi133:check power output: Chassis Power is off 2023-09-30T02:01:29.017 INFO:teuthology.orchestra.console.smithi133:Power off completed 2023-09-30T02:01:32.884 DEBUG:teuthology.orchestra.console.smithi055:pexpect command: ipmitool -H smithi055.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-09-30T02:01:32.994 DEBUG:teuthology.orchestra.console.smithi055:check power output: Chassis Power is off 2023-09-30T02:01:33.095 INFO:teuthology.orchestra.console.smithi055:Power off completed 2023-09-30T02:01:33.200 INFO:teuthology.run:Summary data: description: rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity random-objectstore$/{bluestore-stupid} supported-random-distro$/{ubuntu_latest} tasks/crash} duration: 843.3639738559723 failure_reason: '"1696038943.0467103 mgr.x (mgr.4103) 1 : cluster [ERR] Unhandled exception from module ''pg_autoscaler'' while running on mgr.x: ''PgAutoscaler'' object has no attribute ''noautoscale''" in cluster log' flavor: default owner: scheduled_yuriw@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=f1bfbcaadf3c4489b9677d5dc23c04f3 status: fail success: false 2023-09-30T02:01:33.200 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-09-30T02:01:33.286 INFO:teuthology.run:FAIL